Feb 26 20:20:33 devstack cinder-volume[73060]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=73060) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 20:20:33 devstack cinder-volume[73060]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=73060) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 20:20:33 devstack cinder-volume[73060]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=73060) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 20:20:33 devstack cinder-volume[73060]: INFO dbcounter [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Registered counter for database cinder Feb 26 20:20:33 devstack cinder-volume[73060]: DEBUG oslo_db.sqlalchemy.engines [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:20:33 devstack cinder-volume[73060]: DEBUG dbcounter [-] [73060] Writer thread running {{(pid=73060) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 26 20:20:33 devstack cinder-volume[73060]: INFO cinder.rpc [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 26 20:20:33 devstack cinder-volume[73060]: INFO cinder.rpc [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 26 20:20:33 devstack cinder-volume[73060]: DEBUG oslo_db.sqlalchemy.engines [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:20:33 devstack cinder-volume[73060]: INFO cinder.volume.manager [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Determined volume DB was empty at startup. Feb 26 20:20:33 devstack cinder-volume[73060]: DEBUG cinder.volume.manager [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=73060) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 26 20:20:33 devstack cinder-volume[73060]: INFO cinder.volume.manager [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 26 20:20:33 devstack cinder-volume[73060]: WARNING stevedore.named [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 26 20:20:33 devstack cinder-volume[73060]: WARNING castellan.key_manager [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 20:20:33 devstack cinder-volume[73060]: WARNING cinder.keymgr.conf_key_mgr [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 20:20:33 devstack cinder-volume[73060]: DEBUG cinder.volume.drivers.lvm [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=73060) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Feb 26 20:20:33 devstack cinder-volume[73060]: DEBUG oslo_concurrency.processutils [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=73060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_concurrency.processutils [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] CMD "cinder-rtstool verify" returned: 0 in 0.222s {{(pid=73060) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_db.sqlalchemy.engines [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:20:34 devstack cinder-volume[73060]: INFO cinder.rpc [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Feb 26 20:20:34 devstack cinder-volume[73060]: INFO cinder.rpc [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Feb 26 20:20:34 devstack cinder-volume[73060]: WARNING stevedore.named [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 26 20:20:34 devstack cinder-volume[73060]: WARNING castellan.key_manager [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 20:20:34 devstack cinder-volume[73060]: INFO cinder.volume.manager [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Image-volume cache enabled for host devstack@lvmdriver-1. Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_db.sqlalchemy.engines [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:20:34 devstack cinder-volume[73060]: INFO oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Starting 1 workers Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Started child 73160 {{(pid=73060) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Full set of CONF: {{(pid=73060) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] ******************************************************************************** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Configuration options gathered from: {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] ================================================================================ {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] allow_availability_zone_fallback = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] allow_compression_on_image_upload = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] allowed_direct_url_schemes = [] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] api_rate_limit = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] auth_strategy = keystone {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] az_cache_duration = 3600 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_availability_zone = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_host = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_name = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_stats_polling_interval = 60 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backup_api_class = cinder.backup.api.API {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backup_name_template = backup-%s {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backup_use_same_host = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backup_use_temp_snapshot = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] chap_password = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] chap_username = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cinder_internal_tenant_project_id = 879fd0025c694c4590c17f1075e5e3be {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cinder_internal_tenant_user_id = 4af108b07b58430aa1b454b41bdbac85 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cloned_volume_same_az = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cluster = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] compression_format = gzip {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] compute_api_class = cinder.compute.nova.API {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] config_dir = [] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] config_source = [] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] control_exchange = openstack {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] debug = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] default_availability_zone = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] default_group_type = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73160]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] default_volume_type = lvmdriver-1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] disk_geometry = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] driver_client_cert = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] driver_client_cert_key = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] driver_data_namespace = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] driver_ssl_cert_path = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] driver_ssl_cert_verify = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] driver_use_ssl = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] enable_force_upload = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] enable_new_services = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] enable_unsupported_driver = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] enabled_backends = ['lvmdriver-1'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] enforce_multipath_for_image_xfer = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] filter_function = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance_api_insecure = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance_api_ssl_compression = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance_ca_certificates_file = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance_catalog_info = image:glance:publicURL {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance_certfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance_keyfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance_num_retries = 3 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance_request_timeout = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] goodness_function = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] graceful_shutdown_timeout = 5 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] group_api_class = cinder.group.api.API {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] host = devstack {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] image_compress_on_upload = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] image_conversion_address_space_limit = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] image_conversion_cpu_limit = 60 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] image_conversion_disable = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] image_upload_use_cinder_backend = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] image_upload_use_internal_tenant = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] image_volume_cache_enabled = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] image_volume_cache_max_count = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] image_volume_cache_max_size_gb = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] init_host_max_objects_retrieval = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] instance_format = [instance: %(uuid)s] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] iscsi_target_flags = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] iscsi_write_cache = on {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] iser_helper = tgtadm {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] iser_ip_address = 192.168.122.208 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] iser_port = 3260 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] log_color = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] log_config_append = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] log_dir = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] log_file = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] log_options = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] log_rotate_interval = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] log_rotate_interval_type = days {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] log_rotation_type = none {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] max_age = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] max_logfile_count = 30 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] max_logfile_size_mb = 200 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] max_over_subscription_ratio = 20.0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] message_reap_interval = 86400 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] message_ttl = 2592000 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] migration_create_volume_timeout_secs = 300 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] monkey_patch = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] monkey_patch_modules = [] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] my_ip = 192.168.122.208 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] no_snapshot_gb_quota = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] num_iser_scan_tries = 3 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] num_shell_tries = 3 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] num_volume_device_scan_tries = 3 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] nvmeof_conn_info_version = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] nvmet_ns_id = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] nvmet_port_id = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] osapi_max_limit = 1000 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] osapi_volume_ext_list = [] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] osapi_volume_listen = 0.0.0.0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] osapi_volume_listen_port = 8776 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] osapi_volume_use_ssl = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] osapi_volume_workers = 2 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] per_volume_size_limit = -1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] periodic_fuzzy_delay = 60 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] periodic_interval = 60 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] project_id_regex = [0-9a-f\-]+ {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] public_endpoint = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] publish_errors = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] quota_backup_gigabytes = 1000 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] quota_backups = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] quota_gigabytes = 1000 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] quota_groups = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] quota_snapshots = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] quota_volumes = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] rate_limit_burst = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] rate_limit_except_level = CRITICAL {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] rate_limit_interval = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] reinit_driver_count = 3 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] replication_device = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] report_discard_supported = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] report_interval = 120 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] reservation_clean_interval = 86400 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] reservation_expire = 86400 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] reserved_image_namespaces = [] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] reserved_percentage = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] rpc_response_timeout = 120 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] run_external_periodic_tasks = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] scst_target_driver = iscsi {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] scst_target_iqn_name = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] service_down_time = 720 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] shell_completion = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] snapshot_name_template = snapshot-%s {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] snapshot_same_host = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] split_loggers = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] state_path = /opt/stack/data/cinder {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] storage_availability_zone = nova {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] storage_protocol = iSCSI {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] syslog_log_facility = LOG_USER {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] target_helper = lioadm {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] target_ip_address = 192.168.122.208 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] target_port = 3260 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] target_protocol = iscsi {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] target_secondary_ip_addresses = [] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] trace_flags = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] transfer_api_class = cinder.transfer.api.API {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] transport_url = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] until_refresh = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] use_chap_auth = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] use_default_quota_class = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] use_journal = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] use_json = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] use_multipath_for_image_xfer = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] use_stderr = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] use_syslog = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] verify_glance_signatures = enabled {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volume_api_class = cinder.volume.api.API {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volume_backend_name = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volume_clear = zero {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volume_clear_ionice = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volume_clear_size = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volume_copy_bps_limit = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volume_dd_blocksize = 1M {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volume_name_template = volume-%s {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volume_service_inithost_offload = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volume_usage_audit_period = month {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] zoning_mode = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_concurrency.disable_process_locking = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.admin_password = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.admin_token = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.admin_user = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.auth_admin_prefix = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.auth_port = 35357 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.auth_protocol = https {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.auth_section = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.auth_type = password {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.auth_uri = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.auth_version = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.cache = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.certfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.delay_auth_decision = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.http_connect_timeout = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.identity_uri = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.include_service_catalog = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.insecure = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.interface = public {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.keyfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_password = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcache_username = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.region_name = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.service_token_roles_required = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.service_type = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.token_cache_time = 300 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.backend = dogpile.cache.null {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.backend_argument = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.backend_expiration_time = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.config_prefix = cache.oslo {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.debug_cache_backend = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.enable_retry_client = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.enable_socket_keepalive = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.enabled = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.enforce_fips_mode = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.expiration_time = 600 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.hashclient_retry_attempts = 2 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.memcache_dead_retry = 300 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.memcache_pool_maxsize = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.memcache_sasl_enabled = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.password = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.proxies = [] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.redis_db = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.redis_sentinel_service_name = mymaster {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.redis_server = localhost:6379 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.retry_attempts = 2 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.retry_delay = 0.0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.socket_keepalive_count = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.socket_keepalive_idle = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.socket_keepalive_interval = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.socket_timeout = 1.0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.tls_allowed_ciphers = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.tls_cafile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.tls_certfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.tls_enabled = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.tls_keyfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cache.username = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] coordination.backend_url = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.asyncio_connection = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.asyncio_slave_connection = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.backend = sqlalchemy {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.connection = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.connection_debug = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.connection_parameters = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.connection_recycle_time = 3600 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.connection_trace = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.db_inc_retry_interval = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.db_max_retries = 20 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.db_max_retry_interval = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.db_retry_interval = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.max_overflow = 50 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.max_pool_size = 5 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73160]: INFO cinder.volume.manager [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Starting volume driver LVMVolumeDriver (3.0.0) Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.max_retries = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.mysql_wsrep_sync_wait = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.pool_timeout = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.retry_interval = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.slave_connection = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.sqlite_synchronous = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.synchronous_reader = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] database.use_db_reconnect = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler.connection_string = messaging:// {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler.enabled = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler.es_doc_type = notification {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler.es_scroll_size = 10000 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler.es_scroll_time = 2m {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler.filter_error_trace = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler.hmac_keys = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler.sentinel_service_name = mymaster {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler.socket_timeout = 0.1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler.trace_requests = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler.trace_sqlalchemy = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler_jaeger.process_tags = {} {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler_jaeger.service_name_prefix = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] profiler_otlp.service_name_prefix = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_policy.enforce_new_defaults = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: WARNING oslo_config.cfg [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_policy.enforce_scope = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_policy.policy_default_rule = default {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_policy.policy_file = policy.yaml {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_policy.remote_timeout = 60.0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] privsep_osbrick.group = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] privsep_osbrick.helper_command = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] privsep_osbrick.user = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cinder_sys_admin.group = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cinder_sys_admin.helper_command = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] cinder_sys_admin.user = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] service_user.auth_section = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] service_user.auth_type = password {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] service_user.cafile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] service_user.certfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] service_user.collect_timing = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] service_user.insecure = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] service_user.keyfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] service_user.send_service_user_token = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] service_user.split_loggers = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] service_user.timeout = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance.auth_section = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance.auth_type = password {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance.certfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance.collect_timing = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance.insecure = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance.keyfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance.region_name = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance.split_loggers = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] glance.timeout = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.backend_availability_zone = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.chap_password = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.chap_username = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.disk_geometry = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.driver_client_cert = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.driver_client_cert_key = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.driver_data_namespace = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.driver_use_ssl = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.enable_unsupported_driver = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.extra_capabilities = {} {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.filter_function = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.goodness_function = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.iscsi_target_flags = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.iscsi_write_cache = on {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.iser_helper = tgtadm {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.iser_port = 3260 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.lvm_mirrors = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.lvm_share_target = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.lvm_type = auto {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.num_shell_tries = 3 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.nvmet_port_id = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.replication_device = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.report_discard_supported = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.reserved_percentage = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.scst_target_driver = iscsi {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.scst_target_iqn_name = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.storage_protocol = iSCSI {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.target_helper = tgtadm {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.target_port = 3260 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.target_protocol = iscsi {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.trace_flags = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.unique_fqdn_network = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.use_chap_auth = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.volume_backend_name = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.volume_clear = zero {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.volume_clear_ionice = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.volume_clear_size = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.volume_group = cinder-volumes {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_reports.file_event_handler = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_reports.log_dir = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.backend_availability_zone = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.backend_host = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.chap_password = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.chap_username = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.chiscsi_conf = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.disk_geometry = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.driver_client_cert = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.driver_data_namespace = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.driver_use_ssl = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.extra_capabilities = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.filter_function = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.goodness_function = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.iscsi_write_cache = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.iser_helper = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.iser_ip_address = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.iser_port = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.iser_target_prefix = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.lvm_conf_file = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.lvm_mirrors = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.lvm_share_target = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.lvm_type = auto {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.num_shell_tries = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.nvmet_ns_id = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.nvmet_port_id = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.replication_device = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.report_discard_supported = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.reserved_percentage = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.scst_target_driver = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.storage_protocol = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.target_helper = lioadm {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.target_ip_address = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.target_port = 3260 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.target_protocol = iscsi {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.trace_flags = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.use_chap_auth = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.volume_clear = zero {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.volume_clear_size = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] lvmdriver-1.volumes_dir = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.ssl = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.ssl_version = {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_notifications.driver = [] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_notifications.retry = -1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] oslo_messaging_notifications.transport_url = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] key_manager.fixed_key = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.barbican_api_version = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.barbican_endpoint = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.barbican_endpoint_type = public {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.barbican_region_name = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.cafile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.certfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.collect_timing = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.insecure = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.keyfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.number_of_retries = 60 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.retry_delay = 1 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.send_service_user_token = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.split_loggers = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.timeout = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.verify_ssl = True {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican.verify_ssl_path = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican_service_user.auth_section = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican_service_user.auth_type = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican_service_user.cafile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican_service_user.certfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican_service_user.collect_timing = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican_service_user.insecure = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican_service_user.keyfile = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican_service_user.split_loggers = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] barbican_service_user.timeout = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] vault.approle_role_id = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] vault.approle_secret_id = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] vault.kv_mountpoint = secret {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] vault.kv_path = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] vault.kv_version = 2 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] vault.namespace = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] vault.root_token_id = **** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] vault.ssl_ca_crt_file = None {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] vault.timeout = 60.0 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] vault.use_ssl = False {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:20:34 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] ******************************************************************************** {{(pid=73060) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 26 20:20:34 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:34 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:34 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.011s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:34 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:34 devstack sudo[73164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Feb 26 20:20:34 devstack sudo[73164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:34 devstack sudo[73164]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:34 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.552s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:34 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:34 devstack sudo[73241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 20:20:34 devstack sudo[73241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:35 devstack sudo[73241]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:35 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.584s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:35 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:20:35 devstack cinder-volume[73160]: INFO cinder.brick.local_dev.lvm [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Feb 26 20:20:35 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:35 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.011s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:35 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:35 devstack sudo[73502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 20:20:35 devstack sudo[73502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:36 devstack sudo[73502]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:36 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.574s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:36 devstack cinder-volume[73160]: DEBUG cinder.brick.local_dev.lvm [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73160) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Feb 26 20:20:36 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:36 devstack sudo[73681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 20:20:36 devstack sudo[73681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:36 devstack sudo[73681]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:36 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.805s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:36 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:36 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:36 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:36 devstack sudo[73841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 20:20:36 devstack sudo[73841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:37 devstack sudo[73841]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:37 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.597s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:37 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:37 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:37 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:37 devstack sudo[73877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Feb 26 20:20:37 devstack sudo[73877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:38 devstack sudo[73877]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:38 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.873s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:38 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:38 devstack sudo[74080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 20:20:38 devstack sudo[74080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:39 devstack sudo[74080]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:39 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:39 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:39 devstack sudo[74297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 20:20:39 devstack sudo[74297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:39 devstack sudo[74297]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:39 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.877s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:39 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:40 devstack sudo[74312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:20:40 devstack sudo[74312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:40 devstack sudo[74312]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:40 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.884s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:40 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:40 devstack sudo[74315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 20:20:40 devstack sudo[74315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:41 devstack sudo[74315]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:41 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.719s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:41 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:41 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.011s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:41 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:41 devstack sudo[74385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 20:20:41 devstack sudo[74385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:42 devstack sudo[74385]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:42 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.500s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:42 devstack cinder-volume[73160]: INFO cinder.volume.drivers.lvm [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Enabling LVM thin provisioning by default because a thin pool exists. Feb 26 20:20:42 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:42 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:42 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:42 devstack sudo[74456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 20:20:42 devstack sudo[74456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:42 devstack sudo[74456]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:42 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.427s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:42 devstack cinder-volume[73160]: DEBUG cinder.volume.drivers.lvm [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Updating volume stats {{(pid=73160) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 26 20:20:42 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:42 devstack sudo[74580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 20:20:42 devstack sudo[74580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:43 devstack sudo[74580]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:43 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:43 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:43 devstack sudo[74617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:20:43 devstack sudo[74617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:43 devstack sudo[74617]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:43 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:43 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:43 devstack sudo[74622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 20:20:43 devstack sudo[74622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:43 devstack sudo[74622]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:43 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.460s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:43 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:43 devstack sudo[74629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:20:43 devstack sudo[74629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:44 devstack cinder-volume[73060]: DEBUG dbcounter [-] [73060] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73060) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:20:44 devstack sudo[74629]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:44 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:44 devstack cinder-volume[73160]: INFO cinder.volume.driver [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Driver hasn't implemented _init_vendor_properties() Feb 26 20:20:44 devstack cinder-volume[73160]: DEBUG cinder.volume.driver [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73160) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 26 20:20:44 devstack cinder-volume[73160]: DEBUG oslo_db.sqlalchemy.engines [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73160) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:20:44 devstack cinder-volume[73160]: DEBUG dbcounter [-] [73160] Writer thread running {{(pid=73160) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 26 20:20:44 devstack cinder-volume[73160]: DEBUG cinder.db.sqlalchemy.api [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Building query based on filter {{(pid=73160) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 26 20:20:44 devstack cinder-volume[73160]: DEBUG cinder.image.image_utils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73160) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 26 20:20:44 devstack cinder-volume[73160]: INFO cinder.keymgr.migration [None req-8dddbaf5-6f28-4051-b39d-fefec68b6aba None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 26 20:20:44 devstack cinder-volume[73160]: DEBUG cinder.volume.drivers.lvm [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Updating volume stats {{(pid=73160) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 26 20:20:44 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:44 devstack sudo[74634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 20:20:44 devstack sudo[74634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:45 devstack sudo[74634]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:45 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:45 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:45 devstack sudo[74640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:20:45 devstack sudo[74640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:45 devstack sudo[74640]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:45 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:45 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:45 devstack sudo[74647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 20:20:45 devstack sudo[74647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:45 devstack sudo[74647]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:45 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:45 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:45 devstack sudo[74650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:20:45 devstack sudo[74650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:46 devstack sudo[74650]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:46 devstack cinder-volume[73160]: DEBUG cinder.manager [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Notifying Schedulers of capabilities ... {{(pid=73160) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:20:46 devstack cinder-volume[73160]: INFO cinder.volume.manager [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Driver initialization completed successfully. Feb 26 20:20:46 devstack cinder-volume[73160]: INFO cinder.manager [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Initiating service 2 cleanup Feb 26 20:20:46 devstack cinder-volume[73160]: INFO cinder.manager [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Service 2 cleanup completed. Feb 26 20:20:46 devstack cinder-volume[73160]: DEBUG cinder.service [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Creating RPC server for service cinder-volume {{(pid=73160) start /opt/stack/cinder/cinder/service.py:231}} Feb 26 20:20:46 devstack cinder-volume[73160]: DEBUG cinder.service [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73160) start /opt/stack/cinder/cinder/service.py:237}} Feb 26 20:20:46 devstack cinder-volume[73160]: INFO cinder.volume.manager [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Feb 26 20:20:46 devstack cinder-volume[73160]: DEBUG cinder.volume.drivers.lvm [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Updating volume stats {{(pid=73160) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 26 20:20:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:46 devstack sudo[74707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 20:20:46 devstack sudo[74707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:46 devstack sudo[74707]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:46 devstack sudo[74710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:20:46 devstack sudo[74710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:47 devstack sudo[74710]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:47 devstack sudo[74713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 20:20:47 devstack sudo[74713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:47 devstack sudo[74713]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.429s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:20:47 devstack sudo[74835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:20:47 devstack sudo[74835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:20:48 devstack sudo[74835]: pam_unix(sudo:session): session closed for user root Feb 26 20:20:48 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:20:48 devstack cinder-volume[73160]: INFO cinder.volume.manager [None req-32639e07-2251-4723-b0da-b8a6731a2553 None None] Driver post RPC initialization completed successfully. Feb 26 20:20:58 devstack cinder-volume[73160]: DEBUG dbcounter [-] [73160] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=73160) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:20:58 devstack cinder-volume[73160]: DEBUG dbcounter [-] [73160] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=73160) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:21:46 devstack cinder-volume[73160]: DEBUG oslo_service.periodic_task [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73160) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:21:46 devstack cinder-volume[73160]: DEBUG cinder.volume.drivers.lvm [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Updating volume stats {{(pid=73160) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 26 20:21:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:21:46 devstack sudo[77144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 20:21:46 devstack sudo[77144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:21:46 devstack sudo[77144]: pam_unix(sudo:session): session closed for user root Feb 26 20:21:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:21:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:21:46 devstack sudo[77147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:21:46 devstack sudo[77147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:21:47 devstack sudo[77147]: pam_unix(sudo:session): session closed for user root Feb 26 20:21:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:21:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:21:47 devstack sudo[77150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 20:21:47 devstack sudo[77150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:21:47 devstack sudo[77150]: pam_unix(sudo:session): session closed for user root Feb 26 20:21:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.468s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:21:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:21:47 devstack sudo[77153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:21:47 devstack sudo[77153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:21:48 devstack sudo[77153]: pam_unix(sudo:session): session closed for user root Feb 26 20:21:48 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:21:48 devstack cinder-volume[73160]: DEBUG cinder.manager [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Notifying Schedulers of capabilities ... {{(pid=73160) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:22:46 devstack cinder-volume[73160]: DEBUG oslo_service.periodic_task [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73160) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:22:46 devstack cinder-volume[73160]: DEBUG cinder.volume.drivers.lvm [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Updating volume stats {{(pid=73160) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 26 20:22:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:22:46 devstack sudo[79963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 20:22:46 devstack sudo[79963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:22:46 devstack sudo[79963]: pam_unix(sudo:session): session closed for user root Feb 26 20:22:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.500s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:22:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:22:46 devstack sudo[79966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:22:46 devstack sudo[79966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:22:47 devstack sudo[79966]: pam_unix(sudo:session): session closed for user root Feb 26 20:22:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:22:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:22:47 devstack sudo[79970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 20:22:47 devstack sudo[79970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:22:47 devstack sudo[79970]: pam_unix(sudo:session): session closed for user root Feb 26 20:22:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.440s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:22:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:22:47 devstack sudo[79978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:22:47 devstack sudo[79978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:22:48 devstack sudo[79978]: pam_unix(sudo:session): session closed for user root Feb 26 20:22:48 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:22:48 devstack cinder-volume[73160]: DEBUG cinder.manager [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Notifying Schedulers of capabilities ... {{(pid=73160) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:22:58 devstack cinder-volume[73160]: DEBUG dbcounter [-] [73160] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73160) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:23:46 devstack cinder-volume[73160]: DEBUG oslo_service.periodic_task [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73160) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:23:46 devstack cinder-volume[73160]: DEBUG cinder.volume.drivers.lvm [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Updating volume stats {{(pid=73160) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Feb 26 20:23:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:23:46 devstack sudo[82019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Feb 26 20:23:46 devstack sudo[82019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:23:46 devstack sudo[82019]: pam_unix(sudo:session): session closed for user root Feb 26 20:23:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.452s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:23:46 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:23:46 devstack sudo[82024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:23:46 devstack sudo[82024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:23:47 devstack sudo[82024]: pam_unix(sudo:session): session closed for user root Feb 26 20:23:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:23:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:23:47 devstack sudo[82048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Feb 26 20:23:47 devstack sudo[82048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:23:47 devstack sudo[82048]: pam_unix(sudo:session): session closed for user root Feb 26 20:23:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.423s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:23:47 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:23:47 devstack sudo[82054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Feb 26 20:23:47 devstack sudo[82054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:23:48 devstack sudo[82054]: pam_unix(sudo:session): session closed for user root Feb 26 20:23:48 devstack cinder-volume[73160]: DEBUG oslo_concurrency.processutils [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=73160) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:23:48 devstack cinder-volume[73160]: DEBUG cinder.manager [None req-e89d6eca-9d56-401e-9e1b-89ad739ddaf0 None None] Notifying Schedulers of capabilities ... {{(pid=73160) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:24:20 devstack cinder-volume[73060]: INFO oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Caught SIGTERM, stopping children Feb 26 20:24:20 devstack cinder-volume[73060]: DEBUG oslo_concurrency.lockutils [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Acquiring lock "singleton_lock" {{(pid=73060) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 20:24:20 devstack cinder-volume[73060]: DEBUG oslo_concurrency.lockutils [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Acquired lock "singleton_lock" {{(pid=73060) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 20:24:20 devstack cinder-volume[73060]: DEBUG oslo_concurrency.lockutils [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Releasing lock "singleton_lock" {{(pid=73060) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 20:24:20 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Stop services. {{(pid=73060) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 26 20:24:20 devstack cinder-volume[73060]: DEBUG oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Killing children. {{(pid=73060) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 26 20:24:20 devstack cinder-volume[73060]: INFO oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Waiting on 1 children to exit Feb 26 20:24:21 devstack cinder-volume[73160]: DEBUG oslo_concurrency.lockutils [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Acquiring lock "singleton_lock" {{(pid=73160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 20:24:21 devstack cinder-volume[73160]: DEBUG oslo_concurrency.lockutils [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Acquired lock "singleton_lock" {{(pid=73160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 20:24:21 devstack cinder-volume[73160]: DEBUG oslo_concurrency.lockutils [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Releasing lock "singleton_lock" {{(pid=73160) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 20:24:21 devstack cinder-volume[73160]: WARNING amqp [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 26 20:24:21 devstack cinder-volume[73160]: WARNING amqp [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 26 20:24:21 devstack cinder-volume[73060]: INFO oslo_service.backend._eventlet.service [None req-be7867a8-d9ee-48c2-94c2-2292cff3533e None None] Child 73160 exited with status 0 Feb 26 20:24:23 devstack cinder-volume[82810]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 20:24:23 devstack cinder-volume[82810]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 20:24:23 devstack cinder-volume[82810]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 20:24:24 devstack cinder-volume[82810]: INFO dbcounter [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Registered counter for database cinder Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_db.sqlalchemy.engines [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82810) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG dbcounter [-] [82810] Writer thread running {{(pid=82810) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 26 20:24:24 devstack cinder-volume[82810]: INFO cinder.rpc [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 26 20:24:24 devstack cinder-volume[82810]: INFO cinder.rpc [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_db.sqlalchemy.engines [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82810) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:24:24 devstack cinder-volume[82810]: INFO cinder.volume.manager [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Determined volume DB was empty at startup. Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG cinder.volume.manager [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82810) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 26 20:24:24 devstack cinder-volume[82810]: INFO cinder.volume.manager [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Service not found for updating active_backend_id, assuming default for driver init. Feb 26 20:24:24 devstack cinder-volume[82810]: WARNING stevedore.named [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 26 20:24:24 devstack cinder-volume[82810]: WARNING castellan.key_manager [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 20:24:24 devstack cinder-volume[82810]: WARNING cinder.keymgr.conf_key_mgr [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 20:24:24 devstack cinder-volume[82810]: INFO cinder.volume.manager [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_db.sqlalchemy.engines [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82810) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:24:24 devstack cinder-volume[82810]: INFO oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Starting 1 workers Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Started child 82928 {{(pid=82810) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Full set of CONF: {{(pid=82810) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] ******************************************************************************** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Configuration options gathered from: {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 26 20:24:24 devstack cinder-volume[82928]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] ================================================================================ {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] allow_availability_zone_fallback = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] allow_compression_on_image_upload = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] allowed_direct_url_schemes = [] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] api_rate_limit = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] auth_strategy = keystone {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_availability_zone = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_host = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_name = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_stats_polling_interval = 60 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backup_api_class = cinder.backup.api.API {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backup_name_template = backup-%s {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backup_use_same_host = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backup_use_temp_snapshot = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] chap_password = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] chap_username = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cinder_internal_tenant_project_id = 879fd0025c694c4590c17f1075e5e3be {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cinder_internal_tenant_user_id = 4af108b07b58430aa1b454b41bdbac85 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cluster = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] compression_format = gzip {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] compute_api_class = cinder.compute.nova.API {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] config_dir = [] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] config_source = [] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] control_exchange = openstack {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] debug = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] default_availability_zone = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] default_group_type = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] default_volume_type = QuobyteHD {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] disk_geometry = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] driver_client_cert = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] driver_client_cert_key = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] driver_data_namespace = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] driver_ssl_cert_path = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] driver_ssl_cert_verify = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] driver_use_ssl = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] enable_new_services = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] enable_unsupported_driver = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] enabled_backends = ['QuobyteHD'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] enforce_multipath_for_image_xfer = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] filter_function = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance_api_insecure = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance_api_ssl_compression = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance_ca_certificates_file = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance_catalog_info = image:glance:publicURL {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance_certfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance_keyfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance_num_retries = 3 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance_request_timeout = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] goodness_function = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] graceful_shutdown_timeout = 5 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] group_api_class = cinder.group.api.API {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] host = devstack {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] image_compress_on_upload = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82928]: INFO cinder.volume.manager [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Starting volume driver QuobyteDriver (1.1.14) Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] image_conversion_address_space_limit = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] image_conversion_cpu_limit = 60 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] image_conversion_disable = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82928]: DEBUG cinder.volume.drivers.remotefs [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82928) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] image_upload_use_cinder_backend = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] image_upload_use_internal_tenant = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] image_volume_cache_enabled = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] image_volume_cache_max_count = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] image_volume_cache_max_size_gb = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] init_host_max_objects_retrieval = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] instance_format = [instance: %(uuid)s] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] iscsi_target_flags = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] iscsi_write_cache = on {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] iser_helper = tgtadm {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] iser_ip_address = 192.168.122.208 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] iser_port = 3260 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] log_color = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] log_config_append = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] log_dir = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] log_file = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] log_options = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] log_rotate_interval = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] log_rotate_interval_type = days {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] log_rotation_type = none {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] max_age = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] max_logfile_count = 30 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] max_logfile_size_mb = 200 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] max_over_subscription_ratio = 20.0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] message_reap_interval = 86400 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] message_ttl = 2592000 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] migration_create_volume_timeout_secs = 300 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] monkey_patch = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] monkey_patch_modules = [] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] my_ip = 192.168.122.208 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] no_snapshot_gb_quota = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] num_iser_scan_tries = 3 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] num_shell_tries = 3 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] num_volume_device_scan_tries = 3 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] nvmeof_conn_info_version = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] nvmet_ns_id = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] nvmet_port_id = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] osapi_max_limit = 1000 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] osapi_volume_ext_list = [] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] osapi_volume_listen_port = 8776 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] osapi_volume_use_ssl = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] osapi_volume_workers = 2 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] per_volume_size_limit = -1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] periodic_fuzzy_delay = 60 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] periodic_interval = 60 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] public_endpoint = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] publish_errors = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] quota_backup_gigabytes = 1000 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] quota_backups = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] quota_gigabytes = 1000 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] quota_groups = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] quota_snapshots = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] quota_volumes = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] rate_limit_burst = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] rate_limit_except_level = CRITICAL {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] rate_limit_interval = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] reinit_driver_count = 3 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] replication_device = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] report_discard_supported = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] report_interval = 120 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] reservation_clean_interval = 86400 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] reservation_expire = 86400 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] reserved_image_namespaces = [] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] reserved_percentage = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] rpc_response_timeout = 120 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] run_external_periodic_tasks = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] scst_target_driver = iscsi {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] scst_target_iqn_name = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] service_down_time = 720 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] shell_completion = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] snapshot_name_template = snapshot-%s {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] split_loggers = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] state_path = /opt/stack/data/cinder {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] storage_availability_zone = nova {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] storage_protocol = iSCSI {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] syslog_log_facility = LOG_USER {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] target_helper = lioadm {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] target_ip_address = 192.168.122.208 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] target_port = 3260 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] target_protocol = iscsi {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] target_secondary_ip_addresses = [] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] trace_flags = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] transport_url = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] until_refresh = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] use_chap_auth = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] use_default_quota_class = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] use_journal = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] use_json = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] use_multipath_for_image_xfer = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] use_stderr = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] use_syslog = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] verify_glance_signatures = enabled {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volume_api_class = cinder.volume.api.API {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volume_backend_name = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volume_clear = zero {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volume_clear_ionice = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volume_clear_size = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volume_copy_bps_limit = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volume_dd_blocksize = 1M {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volume_name_template = volume-%s {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volume_service_inithost_offload = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volume_usage_audit_period = month {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] zoning_mode = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_concurrency.disable_process_locking = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82928]: DEBUG cinder.volume.drivers.quobyte [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82928) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 26 20:24:24 devstack cinder-volume[82928]: WARNING cinder.volume.drivers.quobyte [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 26 20:24:24 devstack cinder-volume[82928]: WARNING cinder.volume.drivers.quobyte [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.admin_password = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82928]: DEBUG oslo_concurrency.processutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Running cmd (subprocess): mount.quobyte {{(pid=82928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.admin_token = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.admin_user = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.auth_port = 35357 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.auth_protocol = https {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.auth_section = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.auth_type = password {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.auth_uri = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.auth_version = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.cache = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.certfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.identity_uri = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.include_service_catalog = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.insecure = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.interface = public {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.keyfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_password = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcache_username = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.region_name = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.service_type = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.backend = dogpile.cache.null {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.backend_argument = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.backend_expiration_time = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.config_prefix = cache.oslo {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.debug_cache_backend = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.enable_retry_client = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.enable_socket_keepalive = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.enabled = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.enforce_fips_mode = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.expiration_time = 600 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.hashclient_retry_attempts = 2 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.memcache_dead_retry = 300 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.memcache_pool_maxsize = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.memcache_sasl_enabled = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.password = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.proxies = [] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.redis_db = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.redis_server = localhost:6379 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.retry_attempts = 2 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.retry_delay = 0.0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.socket_keepalive_count = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.socket_keepalive_idle = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.socket_keepalive_interval = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.socket_timeout = 1.0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.tls_allowed_ciphers = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.tls_cafile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.tls_certfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.tls_enabled = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.tls_keyfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cache.username = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] coordination.backend_url = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.asyncio_connection = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.asyncio_slave_connection = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.backend = sqlalchemy {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.connection = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.connection_debug = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.connection_parameters = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.connection_recycle_time = 3600 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.connection_trace = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.db_inc_retry_interval = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.db_max_retries = 20 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.db_max_retry_interval = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.db_retry_interval = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.max_overflow = 50 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.max_pool_size = 5 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.max_retries = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.mysql_wsrep_sync_wait = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.pool_timeout = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.retry_interval = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.slave_connection = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.sqlite_synchronous = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.synchronous_reader = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] database.use_db_reconnect = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler.connection_string = messaging:// {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler.enabled = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler.es_doc_type = notification {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler.es_scroll_size = 10000 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler.es_scroll_time = 2m {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler.filter_error_trace = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler.hmac_keys = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler.sentinel_service_name = mymaster {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler.socket_timeout = 0.1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler.trace_requests = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler.trace_sqlalchemy = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler_jaeger.process_tags = {} {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler_jaeger.service_name_prefix = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] profiler_otlp.service_name_prefix = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_policy.enforce_new_defaults = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: WARNING oslo_config.cfg [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_policy.enforce_scope = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_policy.policy_default_rule = default {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_policy.policy_file = policy.yaml {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] privsep_osbrick.group = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] privsep_osbrick.helper_command = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] privsep_osbrick.user = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cinder_sys_admin.group = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cinder_sys_admin.helper_command = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] cinder_sys_admin.user = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] service_user.auth_section = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] service_user.auth_type = password {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] service_user.cafile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] service_user.certfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] service_user.collect_timing = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] service_user.insecure = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] service_user.keyfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] service_user.send_service_user_token = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] service_user.split_loggers = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] service_user.timeout = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance.auth_section = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance.auth_type = password {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance.certfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance.collect_timing = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance.insecure = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance.keyfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance.region_name = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance.split_loggers = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] glance.timeout = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.backend_availability_zone = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.chap_password = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.chap_username = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.disk_geometry = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.driver_client_cert = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.driver_client_cert_key = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.driver_data_namespace = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.driver_use_ssl = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.extra_capabilities = {} {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.filter_function = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.goodness_function = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack quobyte-client[82929]: Reading configuration file: /etc/quobyte/client.cfg Feb 26 20:24:24 devstack quobyte-client[82929]: Invalid parameters found, error: missing mount point. Feb 26 20:24:24 devstack quobyte-client[82929]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 26 20:24:24 devstack quobyte-client[82929]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.iscsi_target_flags = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.iscsi_write_cache = on {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.iser_helper = tgtadm {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.iser_port = 3260 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nas_host = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nas_login = admin {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nas_mount_options = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nas_password = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nas_private_key = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nas_share_path = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.num_shell_tries = 3 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82928]: DEBUG oslo_concurrency.processutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] CMD "mount.quobyte" returned: 1 in 0.093s {{(pid=82928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.quobyte_volume_url = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.replication_device = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.report_discard_supported = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.reserved_percentage = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82928]: DEBUG cinder.volume.drivers.quobyte [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=82928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82928]: INFO cinder.volume.drivers.quobyte [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 ... Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82928]: DEBUG oslo_concurrency.processutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c -c /etc/quobyte/client-cinder.cfg {{(pid=82928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.target_helper = tgtadm {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.target_port = 3260 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.target_protocol = iscsi {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.trace_flags = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.unique_fqdn_network = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.use_chap_auth = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.volume_backend_name = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.volume_clear = zero {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.volume_clear_ionice = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.volume_clear_size = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_reports.file_event_handler = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_reports.log_dir = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.backend_availability_zone = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.backend_host = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.chap_password = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.chap_username = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.chiscsi_conf = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.disk_geometry = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.driver_client_cert = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.driver_data_namespace = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.driver_use_ssl = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.extra_capabilities = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.filter_function = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.goodness_function = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack sudo[82930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c -c /etc/quobyte/client-cinder.cfg Feb 26 20:24:24 devstack sudo[82930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.iser_helper = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.iser_ip_address = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.iser_port = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.iser_target_prefix = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nas_host = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nas_login = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nas_mount_options = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nas_password = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nas_private_key = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nas_share_path = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nas_ssh_port = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.num_shell_tries = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.nvmet_port_id = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.replication_device = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.report_discard_supported = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.reserved_percentage = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.scst_target_driver = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.storage_protocol = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.target_helper = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.target_ip_address = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.target_port = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.target_prefix = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.target_protocol = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.trace_flags = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.use_chap_auth = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.volume_clear = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.volume_clear_size = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] QuobyteHD.volumes_dir = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.ssl = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_notifications.driver = [] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_notifications.retry = -1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] key_manager.fixed_key = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.barbican_api_version = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.barbican_endpoint = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.barbican_endpoint_type = public {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.barbican_region_name = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.cafile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.certfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.collect_timing = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.insecure = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.keyfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.number_of_retries = 60 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.retry_delay = 1 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.send_service_user_token = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.split_loggers = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.timeout = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.verify_ssl = True {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican.verify_ssl_path = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican_service_user.auth_section = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican_service_user.auth_type = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican_service_user.cafile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican_service_user.certfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican_service_user.collect_timing = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican_service_user.insecure = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican_service_user.keyfile = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican_service_user.split_loggers = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] barbican_service_user.timeout = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] vault.approle_role_id = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] vault.approle_secret_id = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] vault.kv_mountpoint = secret {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] vault.kv_path = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] vault.kv_version = 2 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] vault.namespace = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] vault.root_token_id = **** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] vault.ssl_ca_crt_file = None {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] vault.timeout = 60.0 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] vault.use_ssl = False {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:24 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] ******************************************************************************** {{(pid=82810) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 26 20:24:25 devstack sudo[82930]: pam_unix(sudo:session): session closed for user root Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG oslo_concurrency.processutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.512s {{(pid=82928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:24:25 devstack cinder-volume[82928]: INFO cinder.volume.drivers.quobyte [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 succeeded Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG cinder.volume.drivers.quobyte [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=82928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.519s {{(pid=82928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG oslo_concurrency.processutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=82928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:24:25 devstack sudo[82999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:24:25 devstack sudo[82999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:24:25 devstack sudo[82999]: pam_unix(sudo:session): session closed for user root Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG oslo_concurrency.processutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.390s {{(pid=82928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:24:25 devstack cinder-volume[82928]: INFO cinder.volume.driver [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Driver hasn't implemented _init_vendor_properties() Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG cinder.volume.driver [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82928) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG oslo_db.sqlalchemy.engines [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82928) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG dbcounter [-] [82928] Writer thread running {{(pid=82928) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG cinder.db.sqlalchemy.api [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Building query based on filter {{(pid=82928) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG cinder.image.image_utils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82928) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 26 20:24:25 devstack cinder-volume[82928]: INFO cinder.keymgr.migration [None req-b7b08b04-487b-407e-83cd-b4deeeaedd3f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG cinder.volume.drivers.quobyte [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=82928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG cinder.volume.drivers.quobyte [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=82928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:24:25 devstack cinder-volume[82928]: DEBUG oslo_concurrency.processutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=82928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:24:25 devstack sudo[83002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:24:25 devstack sudo[83002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:24:26 devstack sudo[83002]: pam_unix(sudo:session): session closed for user root Feb 26 20:24:26 devstack cinder-volume[82928]: DEBUG oslo_concurrency.processutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.385s {{(pid=82928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:24:26 devstack cinder-volume[82928]: DEBUG cinder.manager [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Notifying Schedulers of capabilities ... {{(pid=82928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:24:26 devstack cinder-volume[82928]: INFO cinder.volume.manager [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Driver initialization completed successfully. Feb 26 20:24:26 devstack cinder-volume[82928]: INFO cinder.manager [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Initiating service 3 cleanup Feb 26 20:24:26 devstack cinder-volume[82928]: INFO cinder.manager [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Service 3 cleanup completed. Feb 26 20:24:26 devstack cinder-volume[82928]: DEBUG cinder.service [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Creating RPC server for service cinder-volume {{(pid=82928) start /opt/stack/cinder/cinder/service.py:231}} Feb 26 20:24:26 devstack cinder-volume[82928]: DEBUG cinder.service [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82928) start /opt/stack/cinder/cinder/service.py:237}} Feb 26 20:24:26 devstack cinder-volume[82928]: INFO cinder.volume.manager [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 26 20:24:26 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:24:26 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:24:26 devstack cinder-volume[82928]: DEBUG cinder.volume.drivers.quobyte [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=82928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:24:26 devstack cinder-volume[82928]: DEBUG cinder.volume.drivers.quobyte [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=82928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:24:26 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:24:26 devstack cinder-volume[82928]: DEBUG oslo_concurrency.processutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=82928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:24:26 devstack sudo[83007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:24:26 devstack sudo[83007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:24:26 devstack sudo[83007]: pam_unix(sudo:session): session closed for user root Feb 26 20:24:26 devstack cinder-volume[82928]: DEBUG oslo_concurrency.processutils [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.418s {{(pid=82928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:24:26 devstack cinder-volume[82928]: INFO cinder.volume.manager [None req-326a6656-f4b9-4efd-b9c0-92cab1a4d660 None None] Driver post RPC initialization completed successfully. Feb 26 20:24:29 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-ede3cd81-f951-42b0-bfad-71a78868e40c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:24:29 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-ede3cd81-f951-42b0-bfad-71a78868e40c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:24:29 devstack cinder-volume[82928]: DEBUG cinder.volume.drivers.quobyte [None req-ede3cd81-f951-42b0-bfad-71a78868e40c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=82928) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:24:29 devstack cinder-volume[82928]: DEBUG cinder.volume.drivers.quobyte [None req-ede3cd81-f951-42b0-bfad-71a78868e40c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=82928) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:24:29 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-ede3cd81-f951-42b0-bfad-71a78868e40c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82928) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:24:29 devstack cinder-volume[82928]: DEBUG oslo_concurrency.processutils [None req-ede3cd81-f951-42b0-bfad-71a78868e40c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=82928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:24:29 devstack sudo[83075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:24:29 devstack sudo[83075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:24:30 devstack sudo[83075]: pam_unix(sudo:session): session closed for user root Feb 26 20:24:30 devstack cinder-volume[82928]: DEBUG oslo_concurrency.processutils [None req-ede3cd81-f951-42b0-bfad-71a78868e40c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.378s {{(pid=82928) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:24:30 devstack cinder-volume[82928]: DEBUG cinder.manager [None req-ede3cd81-f951-42b0-bfad-71a78868e40c None None] Notifying Schedulers of capabilities ... {{(pid=82928) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:24:33 devstack cinder-volume[82810]: INFO oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Caught SIGTERM, stopping children Feb 26 20:24:33 devstack cinder-volume[82810]: DEBUG oslo_concurrency.lockutils [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Acquiring lock "singleton_lock" {{(pid=82810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 20:24:33 devstack cinder-volume[82810]: DEBUG oslo_concurrency.lockutils [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Acquired lock "singleton_lock" {{(pid=82810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 20:24:33 devstack cinder-volume[82810]: DEBUG oslo_concurrency.lockutils [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Releasing lock "singleton_lock" {{(pid=82810) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 20:24:33 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Stop services. {{(pid=82810) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Feb 26 20:24:33 devstack cinder-volume[82810]: DEBUG oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Killing children. {{(pid=82810) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Feb 26 20:24:33 devstack cinder-volume[82810]: INFO oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Waiting on 1 children to exit Feb 26 20:24:34 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Acquiring lock "singleton_lock" {{(pid=82928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 20:24:34 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Acquired lock "singleton_lock" {{(pid=82928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 20:24:34 devstack cinder-volume[82928]: DEBUG oslo_concurrency.lockutils [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Releasing lock "singleton_lock" {{(pid=82928) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 20:24:34 devstack cinder-volume[82928]: WARNING amqp [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 26 20:24:34 devstack cinder-volume[82928]: WARNING amqp [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Received method (60, 30) during closing channel 1. This method will be ignored Feb 26 20:24:34 devstack cinder-volume[82810]: INFO oslo_service.backend._eventlet.service [None req-701943a9-43ec-4185-9f07-a0f95df06894 None None] Child 82928 exited with status 0 Feb 26 20:24:36 devstack cinder-volume[83147]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83147) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Feb 26 20:24:36 devstack cinder-volume[83147]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83147) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Feb 26 20:24:36 devstack cinder-volume[83147]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83147) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Feb 26 20:24:37 devstack cinder-volume[83147]: INFO dbcounter [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Registered counter for database cinder Feb 26 20:24:37 devstack cinder-volume[83147]: DEBUG oslo_db.sqlalchemy.engines [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83147) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG dbcounter [-] [83147] Writer thread running {{(pid=83147) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 26 20:24:38 devstack cinder-volume[83147]: INFO cinder.rpc [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Feb 26 20:24:38 devstack cinder-volume[83147]: INFO cinder.rpc [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_db.sqlalchemy.engines [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83147) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:24:38 devstack cinder-volume[83147]: INFO cinder.volume.manager [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Determined volume DB was empty at startup. Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG cinder.volume.manager [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83147) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Feb 26 20:24:38 devstack cinder-volume[83147]: WARNING stevedore.named [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Feb 26 20:24:38 devstack cinder-volume[83147]: WARNING castellan.key_manager [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 20:24:38 devstack cinder-volume[83147]: WARNING cinder.keymgr.conf_key_mgr [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Feb 26 20:24:38 devstack cinder-volume[83147]: INFO cinder.volume.manager [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Image-volume cache disabled for host devstack@QuobyteHD. Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_db.sqlalchemy.engines [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83147) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:24:38 devstack cinder-volume[83147]: INFO oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Starting 1 workers Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Started child 83352 {{(pid=83147) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Full set of CONF: {{(pid=83147) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] ******************************************************************************** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Configuration options gathered from: {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] ================================================================================ {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] allow_availability_zone_fallback = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] allow_compression_on_image_upload = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] allowed_direct_url_schemes = [] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] api_rate_limit = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] auth_strategy = keystone {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_availability_zone = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_host = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_name = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_stats_polling_interval = 60 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backup_api_class = cinder.backup.api.API {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backup_name_template = backup-%s {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backup_use_same_host = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backup_use_temp_snapshot = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] chap_password = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] chap_username = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cinder_internal_tenant_project_id = 879fd0025c694c4590c17f1075e5e3be {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cinder_internal_tenant_user_id = 4af108b07b58430aa1b454b41bdbac85 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cluster = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] compression_format = gzip {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] compute_api_class = cinder.compute.nova.API {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] config_dir = [] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] config_source = [] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] control_exchange = openstack {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] debug = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] default_availability_zone = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] default_group_type = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] default_volume_type = QuobyteHD {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] disk_geometry = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] driver_client_cert = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] driver_client_cert_key = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] driver_data_namespace = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] driver_ssl_cert_path = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] driver_ssl_cert_verify = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] driver_use_ssl = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] enable_new_services = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] enable_unsupported_driver = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] enabled_backends = ['QuobyteHD'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] enforce_multipath_for_image_xfer = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] filter_function = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance_api_insecure = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance_api_servers = ['http://192.168.122.208/image'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance_api_ssl_compression = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance_ca_certificates_file = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance_catalog_info = image:glance:publicURL {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance_certfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance_keyfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance_num_retries = 3 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance_request_timeout = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] goodness_function = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] graceful_shutdown_timeout = 5 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] group_api_class = cinder.group.api.API {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] host = devstack {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] image_compress_on_upload = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] image_conversion_address_space_limit = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] image_conversion_cpu_limit = 60 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] image_conversion_disable = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83352]: INFO cinder.service [-] Starting cinder-volume node (version 27.1.0) Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] image_upload_use_cinder_backend = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] image_upload_use_internal_tenant = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] image_volume_cache_enabled = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] image_volume_cache_max_count = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] image_volume_cache_max_size_gb = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] init_host_max_objects_retrieval = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] instance_format = [instance: %(uuid)s] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] iscsi_target_flags = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] iscsi_write_cache = on {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] iser_helper = tgtadm {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] iser_ip_address = 192.168.122.208 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] iser_port = 3260 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] log_color = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] log_config_append = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] log_dir = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] log_file = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] log_options = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] log_rotate_interval = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] log_rotate_interval_type = days {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] log_rotation_type = none {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] max_age = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] max_logfile_count = 30 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] max_logfile_size_mb = 200 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] max_over_subscription_ratio = 20.0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] message_reap_interval = 86400 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] message_ttl = 2592000 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] migration_create_volume_timeout_secs = 300 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] monkey_patch = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] monkey_patch_modules = [] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] my_ip = 192.168.122.208 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] no_snapshot_gb_quota = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] num_iser_scan_tries = 3 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] num_shell_tries = 3 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] num_volume_device_scan_tries = 3 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] nvmeof_conn_info_version = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] nvmet_ns_id = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] nvmet_port_id = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] osapi_max_limit = 1000 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] osapi_volume_ext_list = [] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] osapi_volume_listen = 0.0.0.0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] osapi_volume_listen_port = 8776 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] osapi_volume_use_ssl = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] osapi_volume_workers = 2 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] per_volume_size_limit = -1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] periodic_fuzzy_delay = 60 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] periodic_interval = 60 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] project_id_regex = [0-9a-f\-]+ {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] public_endpoint = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] publish_errors = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] quota_backup_gigabytes = 1000 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] quota_backups = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] quota_gigabytes = 1000 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] quota_groups = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] quota_snapshots = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] quota_volumes = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] rate_limit_burst = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] rate_limit_except_level = CRITICAL {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] rate_limit_interval = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] reinit_driver_count = 3 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] replication_device = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] report_discard_supported = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] report_interval = 120 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] reservation_clean_interval = 86400 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] reservation_expire = 86400 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] reserved_image_namespaces = [] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] reserved_percentage = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] rpc_response_timeout = 120 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] run_external_periodic_tasks = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] scst_target_driver = iscsi {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] scst_target_iqn_name = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] service_down_time = 720 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] shell_completion = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] snapshot_name_template = snapshot-%s {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] split_loggers = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] state_path = /opt/stack/data/cinder {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] storage_availability_zone = nova {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] storage_protocol = iSCSI {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] syslog_log_facility = LOG_USER {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] target_helper = lioadm {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] target_ip_address = 192.168.122.208 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] target_port = 3260 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] target_protocol = iscsi {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] target_secondary_ip_addresses = [] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] trace_flags = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] transfer_api_class = cinder.transfer.api.API {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] transport_url = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] until_refresh = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] use_chap_auth = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] use_default_quota_class = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] use_journal = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] use_json = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] use_multipath_for_image_xfer = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] use_stderr = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] use_syslog = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] verify_glance_signatures = enabled {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volume_api_class = cinder.volume.api.API {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volume_backend_name = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volume_clear = zero {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volume_clear_ionice = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volume_clear_size = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volume_copy_bps_limit = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volume_dd_blocksize = 1M {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volume_name_template = volume-%s {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volume_service_inithost_offload = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volume_usage_audit_period = month {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] zoning_mode = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_concurrency.disable_process_locking = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.admin_password = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.admin_token = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.admin_user = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.auth_admin_prefix = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.auth_port = 35357 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.auth_protocol = https {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.auth_section = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.auth_type = password {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.auth_uri = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.auth_version = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.cache = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.certfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.delay_auth_decision = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.http_connect_timeout = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.identity_uri = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.include_service_catalog = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.insecure = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.interface = public {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.keyfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_password = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcache_username = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.region_name = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.service_token_roles_required = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.service_type = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.token_cache_time = 300 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.208/identity {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.backend = dogpile.cache.null {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.backend_argument = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.backend_expiration_time = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.config_prefix = cache.oslo {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.debug_cache_backend = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.enable_retry_client = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.enable_socket_keepalive = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.enabled = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.enforce_fips_mode = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.expiration_time = 600 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.hashclient_retry_attempts = 2 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.memcache_dead_retry = 300 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.memcache_pool_maxsize = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.memcache_sasl_enabled = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.password = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.proxies = [] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.redis_db = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.redis_sentinel_service_name = mymaster {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.redis_server = localhost:6379 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.retry_attempts = 2 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.retry_delay = 0.0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.socket_keepalive_count = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.socket_keepalive_idle = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.socket_keepalive_interval = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.socket_timeout = 1.0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.tls_allowed_ciphers = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.tls_cafile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.tls_certfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.tls_enabled = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.tls_keyfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cache.username = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] coordination.backend_url = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.asyncio_connection = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.asyncio_slave_connection = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.backend = sqlalchemy {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.connection = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.connection_debug = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.connection_parameters = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Starting volume driver QuobyteDriver (1.1.14) Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.connection_recycle_time = 3600 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.connection_trace = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.db_inc_retry_interval = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.db_max_retries = 20 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.db_max_retry_interval = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.db_retry_interval = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.max_overflow = 50 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.max_pool_size = 5 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.max_retries = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.mysql_wsrep_sync_wait = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.pool_timeout = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.retry_interval = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.slave_connection = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.sqlite_synchronous = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.synchronous_reader = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] database.use_db_reconnect = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83352) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler.connection_string = messaging:// {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler.enabled = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler.es_doc_type = notification {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler.es_scroll_size = 10000 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler.es_scroll_time = 2m {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler.filter_error_trace = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler.hmac_keys = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler.sentinel_service_name = mymaster {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler.socket_timeout = 0.1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler.trace_requests = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler.trace_sqlalchemy = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler_jaeger.process_tags = {} {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler_jaeger.service_name_prefix = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] profiler_otlp.service_name_prefix = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_policy.enforce_new_defaults = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: WARNING oslo_config.cfg [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_policy.enforce_scope = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_policy.policy_default_rule = default {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_policy.policy_file = policy.yaml {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_policy.remote_timeout = 60.0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] privsep_osbrick.group = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] privsep_osbrick.helper_command = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] privsep_osbrick.user = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cinder_sys_admin.group = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cinder_sys_admin.helper_command = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] cinder_sys_admin.user = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] service_user.auth_section = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] service_user.auth_type = password {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] service_user.cafile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] service_user.certfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] service_user.collect_timing = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] service_user.insecure = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] service_user.keyfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] service_user.send_service_user_token = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] service_user.split_loggers = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] service_user.timeout = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance.auth_section = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance.auth_type = password {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance.certfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance.collect_timing = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance.insecure = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance.keyfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance.region_name = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance.split_loggers = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] glance.timeout = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.backend_availability_zone = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.chap_password = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.chap_username = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.disk_geometry = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.driver_client_cert = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.driver_client_cert_key = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.driver_data_namespace = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.driver_use_ssl = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.enable_unsupported_driver = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.extra_capabilities = {} {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.filter_function = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.goodness_function = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.iscsi_target_flags = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.iscsi_write_cache = on {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.iser_helper = tgtadm {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.iser_ip_address = 192.168.122.208 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.iser_port = 3260 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nas_host = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nas_login = admin {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nas_mount_options = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nas_password = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nas_private_key = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nas_share_path = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nas_ssh_port = 22 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.num_shell_tries = 3 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.nvmet_port_id = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.quobyte_client_cfg = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.quobyte_volume_url = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.replication_device = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.report_discard_supported = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.reserved_percentage = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.scst_target_driver = iscsi {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.scst_target_iqn_name = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.storage_protocol = iSCSI {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.target_helper = tgtadm {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.target_ip_address = 192.168.122.208 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.target_port = 3260 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.target_protocol = iscsi {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.trace_flags = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.unique_fqdn_network = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.use_chap_auth = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.volume_backend_name = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.volume_clear = zero {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.volume_clear_ionice = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.volume_clear_size = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_reports.file_event_handler = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_reports.log_dir = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.backend_availability_zone = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.backend_host = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.chap_password = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.chap_username = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.chiscsi_conf = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.disk_geometry = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.driver_client_cert = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.driver_client_cert_key = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.driver_data_namespace = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.driver_use_ssl = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.extra_capabilities = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.filter_function = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.goodness_function = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.iscsi_target_flags = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.iscsi_write_cache = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.iser_helper = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.iser_ip_address = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.iser_port = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.iser_target_prefix = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nas_host = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nas_login = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nas_mount_options = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nas_password = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nas_private_key = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nas_share_path = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nas_ssh_port = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.num_shell_tries = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nvmet_ns_id = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.nvmet_port_id = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.replication_device = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.report_discard_supported = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.reserved_percentage = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.scst_target_driver = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.storage_protocol = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.target_helper = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.target_ip_address = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.target_port = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.target_prefix = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.target_protocol = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.trace_flags = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.unique_fqdn_network = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.use_chap_auth = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.volume_clear = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.volume_clear_ionice = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.volume_clear_size = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] QuobyteHD.volumes_dir = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83352) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.quobyte [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.quobyte [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Running cmd (subprocess): mount.quobyte {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.ssl = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.ssl_version = {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_notifications.driver = [] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_notifications.retry = -1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] oslo_messaging_notifications.transport_url = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] key_manager.fixed_key = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.barbican_api_version = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.barbican_endpoint = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.barbican_endpoint_type = public {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.barbican_region_name = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.cafile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.certfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.collect_timing = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.insecure = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.keyfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.number_of_retries = 60 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.retry_delay = 1 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.send_service_user_token = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.split_loggers = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.timeout = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.verify_ssl = True {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican.verify_ssl_path = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican_service_user.auth_section = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican_service_user.auth_type = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican_service_user.cafile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican_service_user.certfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican_service_user.collect_timing = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican_service_user.insecure = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican_service_user.keyfile = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican_service_user.split_loggers = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] barbican_service_user.timeout = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] vault.approle_role_id = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] vault.approle_secret_id = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] vault.kv_mountpoint = secret {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] vault.kv_path = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] vault.kv_version = 2 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] vault.namespace = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] vault.root_token_id = **** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] vault.ssl_ca_crt_file = None {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] vault.timeout = 60.0 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] vault.use_ssl = False {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Feb 26 20:24:38 devstack cinder-volume[83147]: DEBUG oslo_service.backend._eventlet.service [None req-6eec747f-9654-4e77-8eee-ad3700cb282f None None] ******************************************************************************** {{(pid=83147) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Feb 26 20:24:38 devstack quobyte-client[83354]: Reading configuration file: /etc/quobyte/client.cfg Feb 26 20:24:38 devstack quobyte-client[83354]: Invalid parameters found, error: missing mount point. Feb 26 20:24:38 devstack quobyte-client[83354]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Feb 26 20:24:38 devstack quobyte-client[83354]: Failed to parse all commandline parameters, please use -h/--help to see available options. Feb 26 20:24:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] CMD "mount.quobyte" returned: 1 in 0.079s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:24:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:24:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:24:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:24:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:24:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:24:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:24:38 devstack sudo[83359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:24:38 devstack sudo[83359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:24:39 devstack sudo[83359]: pam_unix(sudo:session): session closed for user root Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.779s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:24:39 devstack cinder-volume[83352]: INFO cinder.volume.driver [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Driver hasn't implemented _init_vendor_properties() Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG cinder.volume.driver [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83352) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG oslo_db.sqlalchemy.engines [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writer thread running {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG cinder.db.sqlalchemy.api [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Building query based on filter {{(pid=83352) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83352) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:24:39 devstack cinder-volume[83352]: INFO cinder.keymgr.migration [None req-8a70e727-feb3-420c-b160-8c8ba40b8f8c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Feb 26 20:24:39 devstack sudo[83398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:24:39 devstack sudo[83398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:24:39 devstack sudo[83398]: pam_unix(sudo:session): session closed for user root Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.401s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:24:39 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Driver initialization completed successfully. Feb 26 20:24:39 devstack cinder-volume[83352]: INFO cinder.manager [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Initiating service 3 cleanup Feb 26 20:24:39 devstack cinder-volume[83352]: INFO cinder.manager [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Service 3 cleanup completed. Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG cinder.service [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Creating RPC server for service cinder-volume {{(pid=83352) start /opt/stack/cinder/cinder/service.py:231}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG cinder.service [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83352) start /opt/stack/cinder/cinder/service.py:237}} Feb 26 20:24:39 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:24:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:24:39 devstack sudo[83409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:24:39 devstack sudo[83409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:24:40 devstack sudo[83409]: pam_unix(sudo:session): session closed for user root Feb 26 20:24:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.388s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:24:40 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-768dba34-b4a5-415c-a4c0-03ed4698488d None None] Driver post RPC initialization completed successfully. Feb 26 20:24:48 devstack cinder-volume[83147]: DEBUG dbcounter [-] [83147] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=83147) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:24:49 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=1 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:24:50 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Flow 'volume_create_manager' (b30efe87-0282-4eaf-b2f2-1e3317adf258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80350be9-1c78-45e6-9fd7-7eb683927e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80350be9-1c78-45e6-9fd7-7eb683927e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-683229616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa675c18-a4b7-4a93-9496-252dec08da67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3be2e928c94aa6a281230aca0bb30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:25:40Z,use_quota=True,user_id='9ae1788b882d4286b8ec509f16260c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b98535c-2862-4230-949c-e16975b9a890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b98535c-2862-4230-949c-e16975b9a890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91879f19-d712-4d9b-9176-a3742397312a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91879f19-d712-4d9b-9176-a3742397312a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa675c18-a4b7-4a93-9496-252dec08da67', 'volume_name': 'volume-aa675c18-a4b7-4a93-9496-252dec08da67', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2df5aa5-02ed-4f45-be35-10e23417ed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2df5aa5-02ed-4f45-be35-10e23417ed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8af815c-abf0-48cb-908d-96a952b5e82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:40 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Volume aa675c18-a4b7-4a93-9496-252dec08da67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa675c18-a4b7-4a93-9496-252dec08da67', 'volume_size': 1} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-683229616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa675c18-a4b7-4a93-9496-252dec08da67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e3be2e928c94aa6a281230aca0bb30e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:25:40Z,use_quota=True,user_id='9ae1788b882d4286b8ec509f16260c14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Creating volume aa675c18-a4b7-4a93-9496-252dec08da67 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:25:40 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:40 devstack sudo[83964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67 1073741824 Feb 26 20:25:40 devstack sudo[83964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:40 devstack sudo[83964]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67 1073741824" returned: 0 in 0.634s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:40 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67 Feb 26 20:25:40 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:41 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67" returned: 0 in 0.492s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:25:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8af815c-abf0-48cb-908d-96a952b5e82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa675c18-a4b7-4a93-9496-252dec08da67', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6aad04-16a5-4d85-981c-94a21628ecda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:41 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Volume volume-aa675c18-a4b7-4a93-9496-252dec08da67 (aa675c18-a4b7-4a93-9496-252dec08da67): created successfully Feb 26 20:25:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6aad04-16a5-4d85-981c-94a21628ecda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Flow 'volume_create_manager' (b30efe87-0282-4eaf-b2f2-1e3317adf258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:25:41 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0f3c9c5c-0a71-434c-92ba-27b0f12f3e68 tempest-DeleteServersTestJSON-1161041926 None] Created volume successfully. Feb 26 20:25:44 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:25:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Flow 'volume_create_manager' (f3ab4898-0f11-4d55-b7ac-f96df6bb8cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:25:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f9e567-6697-48dd-b4d5-6bf8f062dcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f9e567-6697-48dd-b4d5-6bf8f062dcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-132901166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d722989c-87c2-4f4b-82d8-3ae0511feac9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c2dbf946ae334a888fe4f44746a4b233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:25:45Z,use_quota=True,user_id='776d734550ba4ea2a9b5c37f7808797d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a79be3-3b20-441f-a225-48ce8b46f29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22a79be3-3b20-441f-a225-48ce8b46f29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27d0738-ff6c-4409-9e0b-fc75f6596442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27d0738-ff6c-4409-9e0b-fc75f6596442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd722989c-87c2-4f4b-82d8-3ae0511feac9', 'volume_name': 'volume-d722989c-87c2-4f4b-82d8-3ae0511feac9', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1ea9bc-847b-43a3-b442-c2f01875ff6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1ea9bc-847b-43a3-b442-c2f01875ff6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36822605-56a9-429d-8176-42007a44bc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:45 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Volume d722989c-87c2-4f4b-82d8-3ae0511feac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d722989c-87c2-4f4b-82d8-3ae0511feac9', 'volume_size': 1} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-132901166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d722989c-87c2-4f4b-82d8-3ae0511feac9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c2dbf946ae334a888fe4f44746a4b233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:25:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:25:45Z,use_quota=True,user_id='776d734550ba4ea2a9b5c37f7808797d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Creating volume d722989c-87c2-4f4b-82d8-3ae0511feac9 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:25:45 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d722989c-87c2-4f4b-82d8-3ae0511feac9 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:45 devstack sudo[84341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d722989c-87c2-4f4b-82d8-3ae0511feac9 1073741824 Feb 26 20:25:45 devstack sudo[84341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:45 devstack sudo[84341]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d722989c-87c2-4f4b-82d8-3ae0511feac9 1073741824" returned: 0 in 0.752s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d722989c-87c2-4f4b-82d8-3ae0511feac9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:45 devstack sudo[84349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d722989c-87c2-4f4b-82d8-3ae0511feac9 Feb 26 20:25:45 devstack sudo[84349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:46 devstack sudo[84349]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d722989c-87c2-4f4b-82d8-3ae0511feac9" returned: 0 in 0.516s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:25:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36822605-56a9-429d-8176-42007a44bc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d722989c-87c2-4f4b-82d8-3ae0511feac9', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb69e20-4fd7-4987-a134-cfa1e366e58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:46 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Volume volume-d722989c-87c2-4f4b-82d8-3ae0511feac9 (d722989c-87c2-4f4b-82d8-3ae0511feac9): created successfully Feb 26 20:25:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb69e20-4fd7-4987-a134-cfa1e366e58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Flow 'volume_create_manager' (f3ab4898-0f11-4d55-b7ac-f96df6bb8cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:25:46 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-8467bbf0-4e66-4682-99a0-4455ed291169 tempest-VolumesTestJSON-795477784 None] Created volume successfully. Feb 26 20:25:47 devstack cinder-volume[83352]: WARNING py.warnings [req-67ebc04f-cc4b-46f8-8852-862f465cecc9 req-cb6b429f-98a4-4bad-b9e4-8dc14022b4b6 tempest-DeleteServersTestJSON-1161041926 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Feb 26 20:25:47 devstack cinder-volume[83352]: .first() Feb 26 20:25:47 devstack cinder-volume[83352]: Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-67ebc04f-cc4b-46f8-8852-862f465cecc9 req-cb6b429f-98a4-4bad-b9e4-8dc14022b4b6 tempest-DeleteServersTestJSON-1161041926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-67ebc04f-cc4b-46f8-8852-862f465cecc9 req-cb6b429f-98a4-4bad-b9e4-8dc14022b4b6 tempest-DeleteServersTestJSON-1161041926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:47 devstack cinder-volume[83352]: INFO oslo.privsep.daemon [req-67ebc04f-cc4b-46f8-8852-862f465cecc9 req-cb6b429f-98a4-4bad-b9e4-8dc14022b4b6 tempest-DeleteServersTestJSON-1161041926 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6w1guio9/privsep.sock'] Feb 26 20:25:47 devstack sudo[84377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6w1guio9/privsep.sock Feb 26 20:25:47 devstack sudo[84377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Flow 'volume_create_manager' (f610e8c7-9986-47a4-b535-8821e8b12401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f690a076-835c-4d61-94de-22a25b76c89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f690a076-835c-4d61-94de-22a25b76c89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-861244073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee101461-d94e-4c14-bbe4-b7b859d8b71f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c2dbf946ae334a888fe4f44746a4b233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:25:48Z,use_quota=True,user_id='776d734550ba4ea2a9b5c37f7808797d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f4afb0-2a96-45a8-b471-25f51e64ec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62f4afb0-2a96-45a8-b471-25f51e64ec5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946f3fcc-5e6c-46b6-8b7c-ba947bae37e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946f3fcc-5e6c-46b6-8b7c-ba947bae37e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee101461-d94e-4c14-bbe4-b7b859d8b71f', 'volume_name': 'volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fd8fc9-57c9-4a8f-8d17-95ce888652de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fd8fc9-57c9-4a8f-8d17-95ce888652de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ddcb8a-fb51-4b6d-a5a8-3d5caded1a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:47 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Volume ee101461-d94e-4c14-bbe4-b7b859d8b71f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f', 'volume_size': 1} Feb 26 20:25:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:49 devstack sudo[84377]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:49 devstack cinder-volume[83352]: INFO oslo.privsep.daemon [req-67ebc04f-cc4b-46f8-8852-862f465cecc9 req-cb6b429f-98a4-4bad-b9e4-8dc14022b4b6 tempest-DeleteServersTestJSON-1161041926 None] Spawned new privsep daemon via rootwrap Feb 26 20:25:49 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [req-67ebc04f-cc4b-46f8-8852-862f465cecc9 req-cb6b429f-98a4-4bad-b9e4-8dc14022b4b6 tempest-DeleteServersTestJSON-1161041926 None] Accepted privsep connection to /tmp/tmp6w1guio9/privsep.sock {{(pid=83352) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Feb 26 20:25:49 devstack cinder-volume[83352]: INFO oslo.privsep.daemon [-] privsep daemon starting Feb 26 20:25:49 devstack cinder-volume[83352]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Feb 26 20:25:49 devstack cinder-volume[83352]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Feb 26 20:25:49 devstack cinder-volume[83352]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84381 Feb 26 20:25:49 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0475b99-4803-4dd2-bb7e-6764046f0336]: (2,) {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:25:49 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[5797dca7-9cd6-4485-a1d4-eaf3c022797c]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:25:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-67ebc04f-cc4b-46f8-8852-862f465cecc9 req-cb6b429f-98a4-4bad-b9e4-8dc14022b4b6 tempest-DeleteServersTestJSON-1161041926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:49 devstack sudo[84390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67 Feb 26 20:25:49 devstack sudo[84390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:50 devstack sudo[84390]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-67ebc04f-cc4b-46f8-8852-862f465cecc9 req-cb6b429f-98a4-4bad-b9e4-8dc14022b4b6 tempest-DeleteServersTestJSON-1161041926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67" returned: 0 in 0.747s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-67ebc04f-cc4b-46f8-8852-862f465cecc9 req-cb6b429f-98a4-4bad-b9e4-8dc14022b4b6 tempest-DeleteServersTestJSON-1161041926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.407s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.315s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-861244073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee101461-d94e-4c14-bbe4-b7b859d8b71f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c2dbf946ae334a888fe4f44746a4b233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:25:48Z,use_quota=True,user_id='776d734550ba4ea2a9b5c37f7808797d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Creating volume ee101461-d94e-4c14-bbe4-b7b859d8b71f {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:25:50 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Flow 'volume_create_manager' (96e5dbfa-5ec1-4f05-ad5a-20d386192dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:25:50 devstack sudo[84397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f 1073741824 Feb 26 20:25:50 devstack sudo[84397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b511bd-71f9-4f4c-8fe7-d0f34b467e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b511bd-71f9-4f4c-8fe7-d0f34b467e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1805297286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2ef42ef2c9465b85fa477ab5950c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:25:50Z,use_quota=True,user_id='2458438a41c54e2aa7f7276f5e12da12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870c5802-e5d8-471b-889e-2169a7276e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (870c5802-e5d8-471b-889e-2169a7276e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae947189-d067-4a43-b885-e117934edc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae947189-d067-4a43-b885-e117934edc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628', 'volume_name': 'volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33db28ef-cb4a-4172-964c-7bbdddc88c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33db28ef-cb4a-4172-964c-7bbdddc88c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137fe94e-233c-43d4-824a-53f46e70e0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:50 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Volume 6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628', 'volume_size': 1} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-67ebc04f-cc4b-46f8-8852-862f465cecc9 req-cb6b429f-98a4-4bad-b9e4-8dc14022b4b6 tempest-DeleteServersTestJSON-1161041926 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316', 'name': 'volume-aa675c18-a4b7-4a93-9496-252dec08da67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7435152b-bfac-4bcf-ba12-9a018ac54bc1', 'enforce_multipath': True} {{(pid=83352) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 26 20:25:50 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-67ebc04f-cc4b-46f8-8852-862f465cecc9 req-cb6b429f-98a4-4bad-b9e4-8dc14022b4b6 tempest-DeleteServersTestJSON-1161041926 None] attachment_update completed successfully. Feb 26 20:25:51 devstack sudo[84397]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f 1073741824" returned: 0 in 0.955s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:51 devstack sudo[84470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f Feb 26 20:25:51 devstack sudo[84470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:51 devstack sudo[84470]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f" returned: 0 in 0.493s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.377s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1805297286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba2ef42ef2c9465b85fa477ab5950c43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:25:50Z,use_quota=True,user_id='2458438a41c54e2aa7f7276f5e12da12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Creating volume 6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:25:51 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:51 devstack sudo[84789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628 1073741824 Feb 26 20:25:51 devstack sudo[84789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ddcb8a-fb51-4b6d-a5a8-3d5caded1a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a3c1d8-c926-42ba-b538-84b5833b3a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:51 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Volume volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f (ee101461-d94e-4c14-bbe4-b7b859d8b71f): created successfully Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a3c1d8-c926-42ba-b538-84b5833b3a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Flow 'volume_create_manager' (f610e8c7-9986-47a4-b535-8821e8b12401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:25:51 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f740c508-bf68-42f5-805a-5cd317c0b64b tempest-VolumesTestJSON-795477784 None] Created volume successfully. Feb 26 20:25:52 devstack sudo[84789]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628 1073741824" returned: 0 in 0.577s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:52 devstack sudo[84794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628 Feb 26 20:25:52 devstack sudo[84794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:52 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:25:52 devstack sudo[84794]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:52 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Flow 'volume_create_manager' (588c3f5d-06c2-494c-9b58-bb5f2a1bb606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:25:52 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1598e3c7-3746-4c79-ba0a-97549284e844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628" returned: 0 in 0.632s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:25:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1598e3c7-3746-4c79-ba0a-97549284e844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-842966991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1507cd88-6cd7-442e-807e-40d3410d8adc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c2dbf946ae334a888fe4f44746a4b233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:25:53Z,use_quota=True,user_id='776d734550ba4ea2a9b5c37f7808797d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d4ca8d-c742-4821-a32d-8b5723b99490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d4ca8d-c742-4821-a32d-8b5723b99490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe85c1e6-ee11-428a-8ee9-987b69c6a885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe85c1e6-ee11-428a-8ee9-987b69c6a885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1507cd88-6cd7-442e-807e-40d3410d8adc', 'volume_name': 'volume-1507cd88-6cd7-442e-807e-40d3410d8adc', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fff6a8-d780-440a-a480-b0038798e523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fff6a8-d780-440a-a480-b0038798e523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbe68df-6d0c-4f72-8766-269b9c7c86ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:53 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Volume 1507cd88-6cd7-442e-807e-40d3410d8adc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1507cd88-6cd7-442e-807e-40d3410d8adc', 'volume_size': 1} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:25:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-842966991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1507cd88-6cd7-442e-807e-40d3410d8adc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c2dbf946ae334a888fe4f44746a4b233',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:25:53Z,use_quota=True,user_id='776d734550ba4ea2a9b5c37f7808797d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Creating volume 1507cd88-6cd7-442e-807e-40d3410d8adc {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:25:53 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1507cd88-6cd7-442e-807e-40d3410d8adc 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (137fe94e-233c-43d4-824a-53f46e70e0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:53 devstack sudo[84798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1507cd88-6cd7-442e-807e-40d3410d8adc 1073741824 Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb28ea2-180e-4be7-895c-e624201cf4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:53 devstack sudo[84798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:53 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Volume volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628 (6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628): created successfully Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb28ea2-180e-4be7-895c-e624201cf4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Flow 'volume_create_manager' (96e5dbfa-5ec1-4f05-ad5a-20d386192dcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:25:53 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-403567e3-71a3-4a87-9d7e-3689131882d6 tempest-VolumesAdminNegativeTest-2063336681 None] Created volume successfully. Feb 26 20:25:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Acquiring lock "cinder-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:25:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Lock "cinder-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:25:54 devstack sudo[84798]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1507cd88-6cd7-442e-807e-40d3410d8adc 1073741824" returned: 0 in 1.111s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Acquiring lock "cinder-quobyte-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:25:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Lock "cinder-quobyte-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:25:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1507cd88-6cd7-442e-807e-40d3410d8adc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:54 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75d268f-fd44-4e31-8472-6bb45576411d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:25:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:54 devstack sudo[84825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1507cd88-6cd7-442e-807e-40d3410d8adc Feb 26 20:25:54 devstack sudo[84825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:54 devstack sudo[84826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628 Feb 26 20:25:54 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:55 devstack sudo[84825]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1507cd88-6cd7-442e-807e-40d3410d8adc" returned: 0 in 0.872s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:55 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628" returned: 0 in 0.874s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fbe68df-6d0c-4f72-8766-269b9c7c86ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1507cd88-6cd7-442e-807e-40d3410d8adc', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac1c85e-c97c-49df-8030-487ccff1ed40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:25:55 devstack sudo[84833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628 Feb 26 20:25:55 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Volume volume-1507cd88-6cd7-442e-807e-40d3410d8adc (1507cd88-6cd7-442e-807e-40d3410d8adc): created successfully Feb 26 20:25:55 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac1c85e-c97c-49df-8030-487ccff1ed40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Flow 'volume_create_manager' (588c3f5d-06c2-494c-9b58-bb5f2a1bb606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:25:55 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-71816d28-361a-4b97-bf30-8b342938faea tempest-VolumesTestJSON-795477784 None] Created volume successfully. Feb 26 20:25:55 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628" returned: 0 in 0.546s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Lock "cinder-quobyte-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628" released by "delete_volume" :: held 1.469s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:25:55 devstack cinder-volume[83352]: WARNING cinder.quota [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:25:55 devstack cinder-volume[83352]: WARNING cinder.quota [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Created reservations ['e04e3883-2639-46d3-ba24-16a0eb024bfd', '820d9e84-aa31-44e6-803d-8f94580be7d9', '8f2f10d3-f883-4331-93af-283ee4e02a64', 'fec6525e-4f3a-4fff-a155-941931a9ce48'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:55 devstack sudo[84836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:25:55 devstack sudo[84836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:56 devstack sudo[84836]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.879s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:56 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:25:56 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Deleted volume successfully. Feb 26 20:25:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9d92bf4e-fd34-49d5-aede-c957a99bafba tempest-VolumesAdminNegativeTest-2063336681 None] Lock "cinder-6b86a4cb-0e11-4c7a-a4dd-d62ae3dd3628-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:25:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Acquiring lock "cinder-1507cd88-6cd7-442e-807e-40d3410d8adc-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:25:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Lock "cinder-1507cd88-6cd7-442e-807e-40d3410d8adc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:25:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Acquiring lock "cinder-quobyte-1507cd88-6cd7-442e-807e-40d3410d8adc" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:25:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Lock "cinder-quobyte-1507cd88-6cd7-442e-807e-40d3410d8adc" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:25:57 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0213b6c8-1890-4db5-89f9-8778b96229ed]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:25:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1507cd88-6cd7-442e-807e-40d3410d8adc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:58 devstack sudo[84915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1507cd88-6cd7-442e-807e-40d3410d8adc Feb 26 20:25:58 devstack sudo[84915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:58 devstack sudo[84915]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1507cd88-6cd7-442e-807e-40d3410d8adc" returned: 0 in 0.617s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1507cd88-6cd7-442e-807e-40d3410d8adc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:58 devstack sudo[84922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1507cd88-6cd7-442e-807e-40d3410d8adc Feb 26 20:25:58 devstack sudo[84922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:59 devstack sudo[84922]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1507cd88-6cd7-442e-807e-40d3410d8adc" returned: 0 in 0.463s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Lock "cinder-quobyte-1507cd88-6cd7-442e-807e-40d3410d8adc" released by "delete_volume" :: held 1.105s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Created reservations ['50e0a2cd-632b-4dda-8441-8d7d8d035391', '15860042-06b5-40e8-8bf2-274df173f1dc', '39e3acfa-e12b-4654-a7a8-bea1f9b525c9', 'db0e5c5d-f194-4387-a497-7eef830791c0'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:25:59 devstack sudo[84925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:25:59 devstack sudo[84925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:25:59 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-2ebf1985-624d-4a31-b698-aad6e25990de req-8f33391d-32ee-42ab-888a-b454b17586cf tempest-DeleteServersTestJSON-1161041926 None] Terminate volume connection completed successfully. Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-2ebf1985-624d-4a31-b698-aad6e25990de req-8f33391d-32ee-42ab-888a-b454b17586cf tempest-DeleteServersTestJSON-1161041926 None] Deleting attachment 7435152b-bfac-4bcf-ba12-9a018ac54bc1. {{(pid=83352) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 26 20:25:59 devstack sudo[84925]: pam_unix(sudo:session): session closed for user root Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.582s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:25:59 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Deleted volume successfully. Feb 26 20:25:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-06b0f5da-d98a-4b4f-a123-4dd77fefb784 tempest-VolumesTestJSON-795477784 None] Lock "cinder-1507cd88-6cd7-442e-807e-40d3410d8adc-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Acquiring lock "cinder-ee101461-d94e-4c14-bbe4-b7b859d8b71f-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Lock "cinder-ee101461-d94e-4c14-bbe4-b7b859d8b71f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Acquiring lock "cinder-quobyte-ee101461-d94e-4c14-bbe4-b7b859d8b71f" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Lock "cinder-quobyte-ee101461-d94e-4c14-bbe4-b7b859d8b71f" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:00 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f224b4c-e7db-4062-a2ac-7d6adbf0d13d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:00 devstack sudo[84934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f Feb 26 20:26:00 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:00 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f" returned: 0 in 0.536s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:00 devstack sudo[84939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f Feb 26 20:26:00 devstack sudo[84939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:01 devstack sudo[84939]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ee101461-d94e-4c14-bbe4-b7b859d8b71f" returned: 0 in 0.410s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Lock "cinder-quobyte-ee101461-d94e-4c14-bbe4-b7b859d8b71f" released by "delete_volume" :: held 0.974s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:01 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Created reservations ['bfeca3f0-077b-487a-b544-32532f2191cf', '76571e82-f548-4281-9edd-231b1d772b0c', '9e7bc5ed-54f8-40b6-9015-a724b36cb06e', '011845b0-ad73-4b19-827d-1a8289248521'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:01 devstack sudo[84942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:26:01 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:01 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.431s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:01 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:26:01 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Deleted volume successfully. Feb 26 20:26:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fce354fd-34a3-4088-9ba0-c7819ec19c87 tempest-VolumesTestJSON-795477784 None] Lock "cinder-ee101461-d94e-4c14-bbe4-b7b859d8b71f-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Acquiring lock "cinder-d722989c-87c2-4f4b-82d8-3ae0511feac9-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Lock "cinder-d722989c-87c2-4f4b-82d8-3ae0511feac9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Acquiring lock "cinder-quobyte-d722989c-87c2-4f4b-82d8-3ae0511feac9" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Lock "cinder-quobyte-d722989c-87c2-4f4b-82d8-3ae0511feac9" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:02 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[425dda6a-ba3e-4ee9-b898-efa07a9992c6]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d722989c-87c2-4f4b-82d8-3ae0511feac9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:02 devstack sudo[84945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d722989c-87c2-4f4b-82d8-3ae0511feac9 Feb 26 20:26:02 devstack sudo[84945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:02 devstack sudo[84945]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d722989c-87c2-4f4b-82d8-3ae0511feac9" returned: 0 in 0.585s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d722989c-87c2-4f4b-82d8-3ae0511feac9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:02 devstack sudo[84950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d722989c-87c2-4f4b-82d8-3ae0511feac9 Feb 26 20:26:02 devstack sudo[84950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:03 devstack sudo[84950]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d722989c-87c2-4f4b-82d8-3ae0511feac9" returned: 0 in 0.436s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Lock "cinder-quobyte-d722989c-87c2-4f4b-82d8-3ae0511feac9" released by "delete_volume" :: held 1.053s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:03 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Created reservations ['cb147d38-b692-4c8f-83cc-71985e87d9b8', 'e89641d6-af8c-4b7a-99de-4fa3f073281c', '66230872-6c6f-4a95-9c61-12005a6e7dec', '39c37a71-e2b9-4045-b464-c8a6db5f3121'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:03 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:03 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:03 devstack sudo[84955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:26:03 devstack sudo[84955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:03 devstack sudo[84955]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.460s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:03 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:26:03 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Deleted volume successfully. Feb 26 20:26:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eea89bb9-4a4d-4cef-8993-0029030d7bc7 tempest-VolumesTestJSON-795477784 None] Lock "cinder-d722989c-87c2-4f4b-82d8-3ae0511feac9-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Acquiring lock "cinder-aa675c18-a4b7-4a93-9496-252dec08da67-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Lock "cinder-aa675c18-a4b7-4a93-9496-252dec08da67-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Acquiring lock "cinder-quobyte-aa675c18-a4b7-4a93-9496-252dec08da67" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Lock "cinder-quobyte-aa675c18-a4b7-4a93-9496-252dec08da67" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:04 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6540c9-8ca9-4697-b475-57532966a348]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:04 devstack sudo[84958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67 Feb 26 20:26:04 devstack sudo[84958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:04 devstack sudo[84958]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67" returned: 0 in 0.595s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:04 devstack sudo[84964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67 Feb 26 20:26:04 devstack sudo[84964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:05 devstack sudo[84964]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa675c18-a4b7-4a93-9496-252dec08da67" returned: 0 in 0.517s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:05 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Lock "cinder-quobyte-aa675c18-a4b7-4a93-9496-252dec08da67" released by "delete_volume" :: held 1.155s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:05 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Created reservations ['19ff4c3b-610b-4964-8e45-72a2e497d83c', '914835ee-f064-443b-ba50-ce41d3f4d903', '360bcddd-7638-4ef6-9c33-741a46dd9069', 'd8065dad-f11b-4783-8f06-620addd9b97a'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:05 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:05 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:05 devstack sudo[84967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:26:05 devstack sudo[84967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:05 devstack sudo[84967]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.502s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:05 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:26:05 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Deleted volume successfully. Feb 26 20:26:06 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-63838a4f-b6ee-4f7d-a915-8e935d6e30f5 tempest-DeleteServersTestJSON-1161041926 None] Lock "cinder-aa675c18-a4b7-4a93-9496-252dec08da67-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Flow 'volume_create_manager' (24098aaf-935e-4c8d-a486-d0ce2f72ee52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d2e4cb-e064-42e8-9afb-2d026fad4b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0d2e4cb-e064-42e8-9afb-2d026fad4b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:07Z,deleted=False,deleted_at=None,display_description='',display_name='c447df88-b553-4d7a-8a64-32bf0a907794-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48dbcc45-cca4-4397-80ec-694492aca0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd0cbdcb0a242009db16bae560e4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:07Z,use_quota=True,user_id='014e7c1663aa45e7a8d3e748497e8356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa52654-81c6-4035-b77d-304349729731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa52654-81c6-4035-b77d-304349729731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04d31cb-6386-4c0b-a02c-9b9b03dc5b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04d31cb-6386-4c0b-a02c-9b9b03dc5b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48dbcc45-cca4-4397-80ec-694492aca0ec', 'volume_name': 'volume-48dbcc45-cca4-4397-80ec-694492aca0ec', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32a298b-0630-4c27-bf2c-854b623573be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32a298b-0630-4c27-bf2c-854b623573be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5813740-19af-4ce7-8f2e-1e15b57dcc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:07 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Volume 48dbcc45-cca4-4397-80ec-694492aca0ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48dbcc45-cca4-4397-80ec-694492aca0ec', 'volume_size': 1} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:07Z,deleted=False,deleted_at=None,display_description='',display_name='c447df88-b553-4d7a-8a64-32bf0a907794-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48dbcc45-cca4-4397-80ec-694492aca0ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd0cbdcb0a242009db16bae560e4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:07Z,use_quota=True,user_id='014e7c1663aa45e7a8d3e748497e8356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Creating volume 48dbcc45-cca4-4397-80ec-694492aca0ec {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:26:07 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:26:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:07 devstack sudo[84971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec 1073741824 Feb 26 20:26:07 devstack sudo[84971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:08 devstack sudo[84971]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec 1073741824" returned: 0 in 0.899s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:08 devstack sudo[84977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec Feb 26 20:26:08 devstack sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:09 devstack sudo[84977]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec" returned: 0 in 0.666s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:09 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:26:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5813740-19af-4ce7-8f2e-1e15b57dcc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48dbcc45-cca4-4397-80ec-694492aca0ec', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be75b20c-68fc-4738-ad69-d8567b7a270b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:09 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Volume volume-48dbcc45-cca4-4397-80ec-694492aca0ec (48dbcc45-cca4-4397-80ec-694492aca0ec): created successfully Feb 26 20:26:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be75b20c-68fc-4738-ad69-d8567b7a270b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Flow 'volume_create_manager' (24098aaf-935e-4c8d-a486-d0ce2f72ee52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:09 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-a67bde33-cc16-476c-9d5e-280265828cff tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Created volume successfully. Feb 26 20:26:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-e4e848c0-51d9-4579-a532-d9a216e734e9 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-e4e848c0-51d9-4579-a532-d9a216e734e9 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:10 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d23f289-d7cb-4677-b5ab-bb3d3f279924]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-e4e848c0-51d9-4579-a532-d9a216e734e9 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:10 devstack sudo[84992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec Feb 26 20:26:10 devstack sudo[84992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:11 devstack sudo[84992]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-e4e848c0-51d9-4579-a532-d9a216e734e9 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec" returned: 0 in 0.647s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-6cd88007-2638-43e0-b221-5f1090de2557 req-e4e848c0-51d9-4579-a532-d9a216e734e9 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.680s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-e4e848c0-51d9-4579-a532-d9a216e734e9 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316', 'name': 'volume-48dbcc45-cca4-4397-80ec-694492aca0ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fbd0b693-40e2-4f92-b1df-0736ee48c4e2', 'enforce_multipath': True} {{(pid=83352) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 26 20:26:11 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-6cd88007-2638-43e0-b221-5f1090de2557 req-e4e848c0-51d9-4579-a532-d9a216e734e9 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] attachment_update completed successfully. Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Flow 'volume_create_manager' (6b6d6d54-f054-4f10-b95b-798c3130706c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a9c8fb8-5e9f-4461-8db8-2808175b2861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a9c8fb8-5e9f-4461-8db8-2808175b2861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-9350587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ada86f-de4d-41c4-ab4d-3511f9a68769,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b6656254e4403b946637f6eec5280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:15Z,use_quota=True,user_id='059b1e9da5194c4fb392e4638612cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86685587-2e75-487a-8d2b-3cae79b4f324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86685587-2e75-487a-8d2b-3cae79b4f324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b01e0ff-70c3-451d-a360-2c593554cb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b01e0ff-70c3-451d-a360-2c593554cb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2ada86f-de4d-41c4-ab4d-3511f9a68769', 'volume_name': 'volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18566117-d89f-44a3-a1d9-e31db5a968f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18566117-d89f-44a3-a1d9-e31db5a968f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47c773a-08fc-432e-b3a0-6c3eadc10d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:15 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Volume c2ada86f-de4d-41c4-ab4d-3511f9a68769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769', 'volume_size': 1} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-9350587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2ada86f-de4d-41c4-ab4d-3511f9a68769,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dd7b6656254e4403b946637f6eec5280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:15Z,use_quota=True,user_id='059b1e9da5194c4fb392e4638612cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Creating volume c2ada86f-de4d-41c4-ab4d-3511f9a68769 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:26:15 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:26:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:15 devstack sudo[85083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769 1073741824 Feb 26 20:26:15 devstack sudo[85083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:16 devstack sudo[85083]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769 1073741824" returned: 0 in 0.613s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:16 devstack sudo[85088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769 Feb 26 20:26:16 devstack sudo[85088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:17 devstack sudo[85088]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769" returned: 0 in 0.933s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:26:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47c773a-08fc-432e-b3a0-6c3eadc10d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de908db-782b-4c65-a628-91f57442c6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:17 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Volume volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769 (c2ada86f-de4d-41c4-ab4d-3511f9a68769): created successfully Feb 26 20:26:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de908db-782b-4c65-a628-91f57442c6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Flow 'volume_create_manager' (6b6d6d54-f054-4f10-b95b-798c3130706c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:17 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-46264db7-b1ff-4194-a38b-fb68762ef5d2 req-8e244eea-2300-4174-adbd-422af7aa8218 tempest-VolumesGetTestJSON-557266323 None] Created volume successfully. Feb 26 20:26:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Acquiring lock "cinder-c2ada86f-de4d-41c4-ab4d-3511f9a68769-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Lock "cinder-c2ada86f-de4d-41c4-ab4d-3511f9a68769-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Acquiring lock "cinder-quobyte-c2ada86f-de4d-41c4-ab4d-3511f9a68769" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Lock "cinder-quobyte-c2ada86f-de4d-41c4-ab4d-3511f9a68769" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:18 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a51e14-fed6-43ab-92e5-0311530e092b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:18 devstack sudo[85432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769 Feb 26 20:26:18 devstack sudo[85432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:18 devstack sudo[85432]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769" returned: 0 in 0.655s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:18 devstack sudo[85437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769 Feb 26 20:26:18 devstack sudo[85437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:19 devstack sudo[85437]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c2ada86f-de4d-41c4-ab4d-3511f9a68769" returned: 0 in 0.613s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Lock "cinder-quobyte-c2ada86f-de4d-41c4-ab4d-3511f9a68769" released by "delete_volume" :: held 1.316s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:19 devstack cinder-volume[83352]: DEBUG cinder.quota [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Created reservations ['993c6100-5db4-40a4-bbc0-4c46270298a9', '1e47db05-a6c0-4699-8cd1-08cbc425bb85', 'd1b863ad-693f-4366-a58f-b82f5293f856', '3c3455c8-dd0b-400e-b15f-264e17370ed0'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:19 devstack sudo[85441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:26:19 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:20 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.640s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:20 devstack cinder-volume[83352]: DEBUG cinder.manager [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:26:20 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Deleted volume successfully. Feb 26 20:26:20 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-b44f387f-d0cb-4571-bc39-d0a5fdb55948 req-d63ddbb2-6360-4c1d-9e5c-3ec7e520c6e1 tempest-VolumesGetTestJSON-557266323 None] Lock "cinder-c2ada86f-de4d-41c4-ab4d-3511f9a68769-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:21 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:26:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Flow 'volume_create_manager' (66862d2b-e01f-4b0a-9628-187c92ac7497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418b3042-9ed9-450d-b14f-46de6381dd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (418b3042-9ed9-450d-b14f-46de6381dd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-81111297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd10df1-ada0-4086-aa19-f4dd1a71e481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f338e07a78c445eae976130b1eb8f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:22Z,use_quota=True,user_id='6c5aa699127344ad871265df6dc90768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2501cc2-e701-4273-bad5-8fc6eecb3472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2501cc2-e701-4273-bad5-8fc6eecb3472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66a5e7d-8db1-46a9-b04d-fbfb8e614992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66a5e7d-8db1-46a9-b04d-fbfb8e614992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fd10df1-ada0-4086-aa19-f4dd1a71e481', 'volume_name': 'volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad879e6-810b-4a87-b0a6-b196e13e7cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad879e6-810b-4a87-b0a6-b196e13e7cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aee83fa-a87d-4939-b3ba-60d70927dd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:21 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Volume 5fd10df1-ada0-4086-aa19-f4dd1a71e481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481', 'volume_size': 1} Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-81111297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fd10df1-ada0-4086-aa19-f4dd1a71e481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f338e07a78c445eae976130b1eb8f7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:22Z,use_quota=True,user_id='6c5aa699127344ad871265df6dc90768',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Creating volume 5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:26:22 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:22 devstack sudo[85444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 1073741824 Feb 26 20:26:22 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:22 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 1073741824" returned: 0 in 0.816s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:22 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-ccd11ef1-0b61-40eb-9452-7b9390295333 tempest-GroupSnapshotsTest-358298352 None] Group tempest-GroupSnapshotsTest-Group-1832829323: creating Feb 26 20:26:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:22 devstack sudo[85449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 Feb 26 20:26:22 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:22 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-ccd11ef1-0b61-40eb-9452-7b9390295333 tempest-GroupSnapshotsTest-358298352 None] Group tempest-GroupSnapshotsTest-Group-1832829323: created successfully Feb 26 20:26:22 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-ccd11ef1-0b61-40eb-9452-7b9390295333 tempest-GroupSnapshotsTest-358298352 None] Create group completed successfully. Feb 26 20:26:23 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481" returned: 0 in 0.428s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aee83fa-a87d-4939-b3ba-60d70927dd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17a8f9f-f333-4c4c-8275-f81e607b2d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:23 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Volume volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 (5fd10df1-ada0-4086-aa19-f4dd1a71e481): created successfully Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17a8f9f-f333-4c4c-8275-f81e607b2d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Flow 'volume_create_manager' (66862d2b-e01f-4b0a-9628-187c92ac7497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:23 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7d7121e9-0fdd-43c8-b5ab-793c9320043b tempest-SnapshotsActionsTest-892907791 None] Created volume successfully. Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Flow 'volume_create_manager' (2f980a66-f6c7-4ed8-8b87-969a76c55ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80ad709-e776-454f-b0c8-016e0ceb5a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80ad709-e776-454f-b0c8-016e0ceb5a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1774503101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d9c747-fe64-4233-8dcf-d7ce36156ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c686952fafd243df9d2c615d7b6aa4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:24Z,use_quota=True,user_id='4531115b93cf46ed896be103d90a389c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c1234e-fcf1-4063-b8d2-6d608116cacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03c1234e-fcf1-4063-b8d2-6d608116cacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65268050-a9b8-4c10-953b-ad3c3f5e30e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65268050-a9b8-4c10-953b-ad3c3f5e30e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3d9c747-fe64-4233-8dcf-d7ce36156ade', 'volume_name': 'volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72f8b06-201f-475a-b997-36aa24d39563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72f8b06-201f-475a-b997-36aa24d39563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cfc5f04-7685-42d3-8f55-937659277c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:24 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Volume f3d9c747-fe64-4233-8dcf-d7ce36156ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade', 'volume_size': 1} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1774503101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d9c747-fe64-4233-8dcf-d7ce36156ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c686952fafd243df9d2c615d7b6aa4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:24Z,use_quota=True,user_id='4531115b93cf46ed896be103d90a389c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Creating volume f3d9c747-fe64-4233-8dcf-d7ce36156ade {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:26:24 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:24 devstack sudo[85452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade 1073741824 Feb 26 20:26:24 devstack sudo[85452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_service.periodic_task [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83352) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:24 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:26:24 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Flow 'volume_create_manager' (52a5fefa-72eb-44da-a1ee-a861f6d46628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d526cb3-da34-4159-a6f3-45695d29d59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d526cb3-da34-4159-a6f3-45695d29d59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1887223819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03e098cd-5dcc-408f-890e-e496b0d98575,host='devstack@QuobyteHD#QuobyteHD',id=28725420-3d98-4617-aa0c-05882a97fa57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390c04c0fe474a7bb81ceff4ab32543f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:24Z,use_quota=True,user_id='53cf61d0e7fc480a85916ec98ebd8753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0c69eb0-8e58-43c5-a56f-6fad54ce9908),volume_type_id=d0c69eb0-8e58-43c5-a56f-6fad54ce9908)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f5998f-5a68-43d5-b350-18398bf89a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87f5998f-5a68-43d5-b350-18398bf89a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a45670-8877-4ce7-93f9-0d5f1b8173c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a45670-8877-4ce7-93f9-0d5f1b8173c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28725420-3d98-4617-aa0c-05882a97fa57', 'volume_name': 'volume-28725420-3d98-4617-aa0c-05882a97fa57', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af70478-d76d-4ce0-876d-072ec1810a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af70478-d76d-4ce0-876d-072ec1810a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553d6987-b76e-4942-8e33-2464c337a149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:24 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Volume 28725420-3d98-4617-aa0c-05882a97fa57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28725420-3d98-4617-aa0c-05882a97fa57', 'volume_size': 1} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:24 devstack sudo[85452]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade 1073741824" returned: 0 in 0.545s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:24 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.419s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:26:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:24 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade Feb 26 20:26:24 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:25 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade" returned: 0 in 0.516s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.944s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cfc5f04-7685-42d3-8f55-937659277c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed296a4-2544-40d7-86fe-9204fa40a604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] Creating offline snapshot 2fa0b1b7-66ee-4409-b190-f0d3c42158d9 of volume 5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:26:25 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Volume volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade (f3d9c747-fe64-4233-8dcf-d7ce36156ade): created successfully Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed296a4-2544-40d7-86fe-9204fa40a604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Flow 'volume_create_manager' (2f980a66-f6c7-4ed8-8b87-969a76c55ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cbf01d-5dc1-441c-ab74-2e9eb6a8c5af]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:25 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-201eae44-1982-464e-9292-c1314250c5fd tempest-VolumeQuotasNegativeTestJSON-362836508 None] Created volume successfully. Feb 26 20:26:25 devstack sudo[85486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 Feb 26 20:26:25 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:25 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481" returned: 0 in 0.525s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:25 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 1G Feb 26 20:26:25 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:26 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 1G" returned: 0 in 0.491s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:26 devstack sudo[85497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:26 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:26 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.516s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:26 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 is being set with open permissions: ugo+rw Feb 26 20:26:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:26 devstack sudo[85512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:26 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Acquiring lock "cinder-f3d9c747-fe64-4233-8dcf-d7ce36156ade-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Lock "cinder-f3d9c747-fe64-4233-8dcf-d7ce36156ade-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Acquiring lock "cinder-quobyte-f3d9c747-fe64-4233-8dcf-d7ce36156ade" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Lock "cinder-quobyte-f3d9c747-fe64-4233-8dcf-d7ce36156ade" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:26 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[891feab6-8dc7-4be9-9a49-f545630a8eef]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:26 devstack sudo[85517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade Feb 26 20:26:26 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:27 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.449s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:27 devstack sudo[85526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.info Feb 26 20:26:27 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:27 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade" returned: 0 in 0.491s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:27 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade Feb 26 20:26:27 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:27 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.info" returned: 0 in 0.424s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:27 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.info is being set with open permissions: ugo+rw Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:27 devstack sudo[85534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.info Feb 26 20:26:27 devstack sudo[85534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:27 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-f3d9c747-fe64-4233-8dcf-d7ce36156ade" returned: 0 in 0.409s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Lock "cinder-quobyte-f3d9c747-fe64-4233-8dcf-d7ce36156ade" released by "delete_volume" :: held 0.926s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Created reservations ['ba5c680a-0e48-4f31-87de-72f04e6a5a48', 'eeb0816e-5a55-47c7-b958-50ed01682464', '3cced407-f49e-42ad-923b-d6e2912969c9', '6b7818a7-3c32-4a83-91a5-c367b1d3f21d'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:27 devstack sudo[85537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:26:27 devstack sudo[85537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:28 devstack sudo[85534]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.info" returned: 0 in 0.445s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.718s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=03e098cd-5dcc-408f-890e-e496b0d98575,created_at=2026-02-26T19:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1887223819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03e098cd-5dcc-408f-890e-e496b0d98575,host='devstack@QuobyteHD#QuobyteHD',id=28725420-3d98-4617-aa0c-05882a97fa57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390c04c0fe474a7bb81ceff4ab32543f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:24Z,use_quota=True,user_id='53cf61d0e7fc480a85916ec98ebd8753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d0c69eb0-8e58-43c5-a56f-6fad54ce9908),volume_type_id=d0c69eb0-8e58-43c5-a56f-6fad54ce9908)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Creating volume 28725420-3d98-4617-aa0c-05882a97fa57 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:26:28 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:28 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 1073741824 Feb 26 20:26:28 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:28 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e6677dce-f0a4-4457-959b-a3d0b57b80fa tempest-SnapshotsActionsTest-892907791 None] Create snapshot completed successfully Feb 26 20:26:28 devstack sudo[85537]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.441s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:26:28 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Deleted volume successfully. Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6c7bf263-1c55-498e-83ad-14cee3110a26 tempest-VolumeQuotasNegativeTestJSON-362836508 None] Lock "cinder-f3d9c747-fe64-4233-8dcf-d7ce36156ade-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:28 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 1073741824" returned: 0 in 0.579s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:28 devstack sudo[85546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 Feb 26 20:26:28 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:29 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57" returned: 0 in 0.472s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.331s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553d6987-b76e-4942-8e33-2464c337a149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28725420-3d98-4617-aa0c-05882a97fa57', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf16a070-6019-427d-9d36-7f71b4835a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] Creating offline snapshot e09946c3-5f2c-4c55-b3bd-6a3095d82327 of volume 5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:26:29 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Volume volume-28725420-3d98-4617-aa0c-05882a97fa57 (28725420-3d98-4617-aa0c-05882a97fa57): created successfully Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf16a070-6019-427d-9d36-7f71b4835a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Flow 'volume_create_manager' (52a5fefa-72eb-44da-a1ee-a861f6d46628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[4907a5f2-484c-4230-8b9a-0389d279e98f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:29 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b16061b1-5c2d-4b85-a9bb-d9c6595edd64 tempest-GroupSnapshotsTest-358298352 None] Created volume successfully. Feb 26 20:26:29 devstack sudo[85550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:29 devstack sudo[85550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:29 devstack sudo[85550]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.579s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:29 devstack sudo[85555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 1G Feb 26 20:26:29 devstack sudo[85555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:30 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] GroupSnapshot 52eaf3b1-ebfe-4a8c-ac98-b04cb03f4cea: creating. Feb 26 20:26:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] Group snapshot 52eaf3b1-ebfe-4a8c-ac98-b04cb03f4cea: creating. {{(pid=83352) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 26 20:26:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:30 devstack sudo[85555]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 1G" returned: 0 in 0.666s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:30 devstack sudo[85560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 Feb 26 20:26:30 devstack sudo[85560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:30 devstack sudo[85560]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327" returned: 0 in 0.490s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:30 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 is being set with open permissions: ugo+rw Feb 26 20:26:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:30 devstack sudo[85565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 Feb 26 20:26:30 devstack sudo[85565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:31 devstack sudo[85565]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327" returned: 0 in 0.659s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.510s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:31 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-833a42b9-47c9-462d-8731-a9ce1aaaf930 tempest-SnapshotsActionsTest-892907791 None] Create snapshot completed successfully Feb 26 20:26:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] Creating offline snapshot ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 of volume 28725420-3d98-4617-aa0c-05882a97fa57 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:26:31 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[03aa3e1f-bff1-46ff-9652-86cf09b56e2b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:31 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 Feb 26 20:26:31 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Acquiring lock "cinder-e09946c3-5f2c-4c55-b3bd-6a3095d82327-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-e09946c3-5f2c-4c55-b3bd-6a3095d82327-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Acquiring lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Flow 'volume_create_manager' (1664dfdb-11ca-4568-bf5a-a5c6c3e665e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7a8c3f-9d60-40a6-a47d-2ca62477c474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7a8c3f-9d60-40a6-a47d-2ca62477c474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1650905936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0822dd9-da26-4e45-bfc4-0d708f9abd0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854e78c846ab42738ba1e381e5ef1af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:32Z,use_quota=True,user_id='e90e88b1cd3a4fd6856f16308f000f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b28b493-1129-40d5-b8f5-f1e3bbef388e),volume_type_id=3b28b493-1129-40d5-b8f5-f1e3bbef388e)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c619415-6af1-4dec-a949-8f0bc5c51780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c619415-6af1-4dec-a949-8f0bc5c51780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32afcbad-3384-4fdb-9dae-6c3a2c9117b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32afcbad-3384-4fdb-9dae-6c3a2c9117b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0822dd9-da26-4e45-bfc4-0d708f9abd0e', 'volume_name': 'volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d88f26-752f-40d8-88d3-9888420f3061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29d88f26-752f-40d8-88d3-9888420f3061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0bc414-3250-4f02-aa57-6d843d43480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:32 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Volume a0822dd9-da26-4e45-bfc4-0d708f9abd0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e', 'volume_size': 1} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" acquired by "delete_snapshot" :: waited 0.067s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Acquiring lock "cinder-quobyte-e09946c3-5f2c-4c55-b3bd-6a3095d82327" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-e09946c3-5f2c-4c55-b3bd-6a3095d82327" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Deleting offline snapshot e09946c3-5f2c-4c55-b3bd-6a3095d82327 of volume 5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] snapshot_file for this snap is: volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76655ca-da86-4443-8147-216328459f5f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:32 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 Feb 26 20:26:32 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:32 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57" returned: 0 in 0.644s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:32 devstack sudo[85603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 1G Feb 26 20:26:32 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:32 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327" returned: 0 in 0.516s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3efc0e4-7c83-4bb1-9942-8634f6156a9c]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:32 devstack sudo[85612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:32 devstack sudo[85612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:32 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 1G" returned: 0 in 0.544s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28725420-3d98-4617-aa0c-05882a97fa57 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:32 devstack sudo[85614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28725420-3d98-4617-aa0c-05882a97fa57 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 Feb 26 20:26:32 devstack sudo[85614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:33 devstack sudo[85612]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.672s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:33 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 Feb 26 20:26:33 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:33 devstack sudo[85614]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28725420-3d98-4617-aa0c-05882a97fa57 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3" returned: 0 in 0.564s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:33 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 is being set with open permissions: ugo+rw: NotImplementedError Feb 26 20:26:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:33 devstack sudo[85624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 Feb 26 20:26:33 devstack sudo[85624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:33 devstack sudo[85624]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3" returned: 0 in 0.407s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:33 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327" returned: 0 in 0.481s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:33 devstack sudo[85654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.info Feb 26 20:26:33 devstack sudo[85654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:33 devstack sudo[85655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327 Feb 26 20:26:33 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:34 devstack sudo[85654]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.info" returned: 0 in 0.453s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:34 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.info is being set with open permissions: ugo+rw: NotImplementedError Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:34 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.e09946c3-5f2c-4c55-b3bd-6a3095d82327" returned: 0 in 0.453s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:34 devstack sudo[85660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.info Feb 26 20:26:34 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-e09946c3-5f2c-4c55-b3bd-6a3095d82327" released by "_delete_snapshot" :: held 2.183s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" released by "delete_snapshot" :: held 2.201s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:34 devstack cinder-volume[83352]: WARNING cinder.quota [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Created reservations ['b4139f01-61d7-418b-b67d-604a3cbdf53f', 'e9b994af-2667-4a9d-b70e-6d7d0f3e65a0', '763d210b-28da-4809-ae69-5f4257c95a69', 'c4de829f-09c3-4448-aea0-9cdaf599d6c9'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:34 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Delete snapshot completed successfully. Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-69783c36-817b-4228-8432-cfdb7b735769 tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-e09946c3-5f2c-4c55-b3bd-6a3095d82327-delete_snapshot" released by "delete_snapshot" :: held 2.409s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:34 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.info" returned: 0 in 0.518s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.211s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.698s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1650905936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0822dd9-da26-4e45-bfc4-0d708f9abd0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='854e78c846ab42738ba1e381e5ef1af9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:32Z,use_quota=True,user_id='e90e88b1cd3a4fd6856f16308f000f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b28b493-1129-40d5-b8f5-f1e3bbef388e),volume_type_id=3b28b493-1129-40d5-b8f5-f1e3bbef388e)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Creating volume a0822dd9-da26-4e45-bfc4-0d708f9abd0e {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:26:34 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:26:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:34 devstack sudo[85663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e 1073741824 Feb 26 20:26:34 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:34 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-78b620c0-7a27-4a0d-97a0-17150ca2d4e0 tempest-GroupSnapshotsTest-358298352 None] group_snapshot 52eaf3b1-ebfe-4a8c-ac98-b04cb03f4cea: created successfully Feb 26 20:26:35 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e 1073741824" returned: 0 in 0.583s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:35 devstack sudo[85668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e Feb 26 20:26:35 devstack sudo[85668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:36 devstack sudo[85668]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e" returned: 0 in 0.579s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.505s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0bc414-3250-4f02-aa57-6d843d43480f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dd38c7-6ca5-40af-acd7-a8fa5a06d5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] Creating offline snapshot 1e1e1160-9194-499c-ab14-fe85fb73cd69 of volume 5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:26:36 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Volume volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e (a0822dd9-da26-4e45-bfc4-0d708f9abd0e): created successfully Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70dd38c7-6ca5-40af-acd7-a8fa5a06d5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Flow 'volume_create_manager' (1664dfdb-11ca-4568-bf5a-a5c6c3e665e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7693669-0b94-4852-93de-81b1a6996fc2]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:36 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-350d48c1-512f-4d16-a6b6-0be39101800b tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Created volume successfully. Feb 26 20:26:36 devstack sudo[85696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:36 devstack sudo[85696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-822bd130-5177-4b8e-ba48-1488261a5fd2 tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-822bd130-5177-4b8e-ba48-1488261a5fd2 tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-822bd130-5177-4b8e-ba48-1488261a5fd2 tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-822bd130-5177-4b8e-ba48-1488261a5fd2 tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-822bd130-5177-4b8e-ba48-1488261a5fd2 tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-822bd130-5177-4b8e-ba48-1488261a5fd2 tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:36 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:26:36 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:36 devstack sudo[85696]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.772s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:36 devstack sudo[85725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 1G Feb 26 20:26:36 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:37 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-822bd130-5177-4b8e-ba48-1488261a5fd2 tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.592s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:37 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-822bd130-5177-4b8e-ba48-1488261a5fd2 tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:26:37 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-822bd130-5177-4b8e-ba48-1488261a5fd2 tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Retype volume completed successfully. Feb 26 20:26:37 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 1G" returned: 0 in 0.624s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:37 devstack sudo[85732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 Feb 26 20:26:37 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:38 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69" returned: 0 in 0.468s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:38 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 is being set with open permissions: ugo+rw Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Acquiring lock "cinder-a0822dd9-da26-4e45-bfc4-0d708f9abd0e-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:38 devstack sudo[85737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 Feb 26 20:26:38 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Lock "cinder-a0822dd9-da26-4e45-bfc4-0d708f9abd0e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Acquiring lock "cinder-quobyte-a0822dd9-da26-4e45-bfc4-0d708f9abd0e" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Lock "cinder-quobyte-a0822dd9-da26-4e45-bfc4-0d708f9abd0e" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[518c6fa4-c6af-46c2-8e60-e581fdc3512d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:38 devstack sudo[85739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e Feb 26 20:26:38 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:38 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69" returned: 0 in 0.470s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.411s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.796s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-ea7cc42a-7e67-4ad2-bbef-7f55c1557da3-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" by "_create_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-ea7cc42a-7e67-4ad2-bbef-7f55c1557da3-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Creating volume 5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8 from snapshot ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 {{(pid=83352) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" by "_copy_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:38 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-89cc4163-57f0-4ffa-aac1-303bb52b0fc5 tempest-SnapshotsActionsTest-892907791 None] Create snapshot completed successfully Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] snapshot: ea7cc42a-7e67-4ad2-bbef-7f55c1557da3, volume: 5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8, {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c45f23d-e670-48f1-9d80-7622842ff4f7]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:38 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e" returned: 0 in 0.526s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:38 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e Feb 26 20:26:38 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:38 devstack sudo[85745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 Feb 26 20:26:38 devstack sudo[85745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Acquiring lock "cinder-1e1e1160-9194-499c-ab14-fe85fb73cd69-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-1e1e1160-9194-499c-ab14-fe85fb73cd69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Acquiring lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Acquiring lock "cinder-quobyte-1e1e1160-9194-499c-ab14-fe85fb73cd69" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-1e1e1160-9194-499c-ab14-fe85fb73cd69" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Deleting offline snapshot 1e1e1160-9194-499c-ab14-fe85fb73cd69 of volume 5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] snapshot_file for this snap is: volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d612a6b-4040-4fd9-8f57-cd11c2d6ee84]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:39 devstack sudo[85749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 Feb 26 20:26:39 devstack sudo[85749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:39 devstack sudo[85745]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3" returned: 0 in 0.560s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28725420-3d98-4617-aa0c-05882a97fa57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Creating direct copy from snapshot {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d7e520-310d-49ee-b636-6b52a7393a0d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:39 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a0822dd9-da26-4e45-bfc4-0d708f9abd0e" returned: 0 in 0.568s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Lock "cinder-quobyte-a0822dd9-da26-4e45-bfc4-0d708f9abd0e" released by "delete_volume" :: held 1.122s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:39 devstack cinder-volume[83352]: WARNING cinder.quota [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:26:39 devstack cinder-volume[83352]: WARNING cinder.quota [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:26:39 devstack sudo[85755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 Feb 26 20:26:39 devstack sudo[85755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Created reservations ['29fb259b-0ffc-4b31-8d77-1bde46a7cdb7', '496d6341-1b5b-4ecb-a0f5-b83b0dbb72d8', 'e7805114-d894-4625-91d6-00b3d9e4dd81', '2a60dc91-d6f8-4d85-8a66-0e1cf5b6035d'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:39 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:26:39 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:39 devstack sudo[85749]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69" returned: 0 in 0.568s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[f091335f-2af8-4e8b-a951-987d82c2df08]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:39 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:39 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:39 devstack sudo[85755]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57" returned: 0 in 0.590s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG cinder.utils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Path /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8 not found in is_blk_device check {{(pid=83352) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:39 devstack sudo[85778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8 Feb 26 20:26:39 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:39 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.450s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:26:39 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Deleted volume successfully. Feb 26 20:26:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f3197fe9-c9ae-485d-bafe-85b85890b5bf tempest-VolumeRetypeWithoutMigrationTest-1527702005 None] Lock "cinder-a0822dd9-da26-4e45-bfc4-0d708f9abd0e-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:40 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.539s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:40 devstack sudo[85783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 Feb 26 20:26:40 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:40 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=102,cinder:UPDATE=106,cinder:DELETE=11,cinder:INSERT=27 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:26:40 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69" returned: 0 in 0.914s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:41 devstack sudo[85813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69 Feb 26 20:26:41 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:42 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.1e1e1160-9194-499c-ab14-fe85fb73cd69" returned: 0 in 1.347s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:42 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" returned: 0 in 2.600s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-1e1e1160-9194-499c-ab14-fe85fb73cd69" released by "_delete_snapshot" :: held 3.430s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" released by "delete_snapshot" :: held 3.444s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:42 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa3020d-6405-4c7a-8453-1387b2df19c1]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:42 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=108,cinder:UPDATE=128,cinder:INSERT=22,cinder:DELETE=11 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:26:42 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Created reservations ['47eb7615-6899-4a90-b1ec-43e96cd65232', '23dfe8a2-ad32-4940-a1d1-18eb1fac3f1c', 'add271bd-2ca2-455f-8e43-abfa587a2a5c', '18eee771-99e1-42dc-98fe-5e743aabe371'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:42 devstack sudo[85816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 Feb 26 20:26:42 devstack sudo[85816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:42 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Delete snapshot completed successfully. Feb 26 20:26:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d529bd13-87ee-4cbb-acc5-7fdf7594071e tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-1e1e1160-9194-499c-ab14-fe85fb73cd69-delete_snapshot" released by "delete_snapshot" :: held 3.554s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:43 devstack sudo[85816]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57" returned: 0 in 0.681s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:43 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57, size 1024.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8 {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:26:43 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Converted 1024.00 MB image at 393.74 MB/s Feb 26 20:26:43 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8 is being set with open permissions: ugo+rw: NotImplementedError Feb 26 20:26:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:43 devstack sudo[85821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8 Feb 26 20:26:43 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:43 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" returned: 0 in 0.549s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" released by "_copy_volume_from_snapshot" :: held 5.048s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-ea7cc42a-7e67-4ad2-bbef-7f55c1557da3-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" released by "_create_volume_from_snapshot" :: held 5.077s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.094s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.099s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] Creating offline snapshot 593cd13f-6fbc-4a99-be1d-eee2daa0af9d of volume 5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:26:43 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eb1064-70fe-4c8a-8bd2-7d462d35ed5a]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:43 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-798f64fe-6fe8-44cb-9688-0c8e6b519449 tempest-GroupSnapshotsTest-358298352 None] Create group from source-snapshot-52eaf3b1-ebfe-4a8c-ac98-b04cb03f4cea completed successfully. Feb 26 20:26:43 devstack sudo[85824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:43 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:44 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.585s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:44 devstack sudo[85829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d 1G Feb 26 20:26:44 devstack sudo[85829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:45 devstack sudo[85829]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d 1G" returned: 0 in 0.823s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:45 devstack sudo[85875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d Feb 26 20:26:45 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" acquired by "delete_volume" :: waited 0.034s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:45 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[92816e95-43e1-40e4-9c55-cc3f5118da98]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:45 devstack sudo[85877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8 Feb 26 20:26:45 devstack sudo[85877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:45 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d" returned: 0 in 0.660s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:45 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d is being set with open permissions: ugo+rw Feb 26 20:26:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:45 devstack sudo[85882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d Feb 26 20:26:45 devstack sudo[85882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:46 devstack sudo[85877]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" returned: 0 in 0.838s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:46 devstack sudo[85892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8 Feb 26 20:26:46 devstack sudo[85892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Flow 'volume_create_manager' (1c968de3-d3bf-4855-84d9-521c5c907b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f68ce96-4fd9-47b0-8001-44ace4e1065f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f68ce96-4fd9-47b0-8001-44ace4e1065f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1316546159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8484705-41e1-46b6-aff0-1cb27a023163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2fa2d1f04d4a55ae823e95a3dd6572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:46Z,use_quota=True,user_id='cfd70a4a960c407aafb5a6af22199243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55487a6b-5dfa-4e25-8892-d64fbd46dc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55487a6b-5dfa-4e25-8892-d64fbd46dc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3134ba63-8127-49b9-b1b5-a8f51b1a974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3134ba63-8127-49b9-b1b5-a8f51b1a974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8484705-41e1-46b6-aff0-1cb27a023163', 'volume_name': 'volume-e8484705-41e1-46b6-aff0-1cb27a023163', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970748f5-e96a-4380-9a52-238a10a6f116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (970748f5-e96a-4380-9a52-238a10a6f116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058797a4-7d0a-431a-a86b-4ffdd1748606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:46 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Volume e8484705-41e1-46b6-aff0-1cb27a023163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8484705-41e1-46b6-aff0-1cb27a023163', 'volume_size': 1} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:46 devstack sudo[85882]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d" returned: 0 in 0.635s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.182s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1316546159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8484705-41e1-46b6-aff0-1cb27a023163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2fa2d1f04d4a55ae823e95a3dd6572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:46Z,use_quota=True,user_id='cfd70a4a960c407aafb5a6af22199243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Creating volume e8484705-41e1-46b6-aff0-1cb27a023163 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:26:46 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e8484705-41e1-46b6-aff0-1cb27a023163 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:46 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e8484705-41e1-46b6-aff0-1cb27a023163 1073741824 Feb 26 20:26:46 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:46 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-8c3764b7-6953-428d-8a49-9758d7eb2a38 tempest-SnapshotsActionsTest-892907791 None] Create snapshot completed successfully Feb 26 20:26:46 devstack sudo[85892]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" returned: 0 in 0.648s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-5a0ac0a4-e5f4-4fe3-82f4-530bf60324b8" released by "delete_volume" :: held 1.510s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Created reservations ['83a09ee2-dd52-4baf-ab48-19d4949cc658'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Acquiring lock "cinder-593cd13f-6fbc-4a99-be1d-eee2daa0af9d-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:46 devstack cinder-volume[83352]: WARNING cinder.quota [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1343484224 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1343484224, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:26:46 devstack cinder-volume[83352]: WARNING cinder.quota [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1343484224 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1343484224, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-593cd13f-6fbc-4a99-be1d-eee2daa0af9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Acquiring lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Created reservations ['b5f7dcca-f444-4f28-90c4-bb0df2ff6b1e', 'c2937410-7b21-44eb-89e8-ec0e97c1f057', '1ff33b0b-8030-4d00-92b9-2efd6d264ecf', 'd026bbe6-17be-440b-88a9-971c8317fbe6'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Acquiring lock "cinder-quobyte-593cd13f-6fbc-4a99-be1d-eee2daa0af9d" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-593cd13f-6fbc-4a99-be1d-eee2daa0af9d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Deleting offline snapshot 593cd13f-6fbc-4a99-be1d-eee2daa0af9d of volume 5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] snapshot_file for this snap is: volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[577fdd4e-c2eb-4c7b-8747-2e53e091cbd4]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:46 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:26:46 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:46 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e8484705-41e1-46b6-aff0-1cb27a023163 1073741824" returned: 0 in 0.535s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:46 devstack sudo[85912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d Feb 26 20:26:46 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e8484705-41e1-46b6-aff0-1cb27a023163 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:46 devstack sudo[85916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e8484705-41e1-46b6-aff0-1cb27a023163 Feb 26 20:26:46 devstack sudo[85916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:47 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.438s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:26:47 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-ffd55a96-d987-45db-991d-3ef8e5236f3e tempest-GroupSnapshotsTest-358298352 None] Delete group completed successfully. Feb 26 20:26:47 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d" returned: 0 in 0.569s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:47 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] group_snapshot 52eaf3b1-ebfe-4a8c-ac98-b04cb03f4cea: deleting Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a02625-8d01-46a7-afff-24ea5eedd1ac]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:47 devstack sudo[85916]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] group_snapshot 52eaf3b1-ebfe-4a8c-ac98-b04cb03f4cea: deleting {{(pid=83352) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e8484705-41e1-46b6-aff0-1cb27a023163" returned: 0 in 0.513s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058797a4-7d0a-431a-a86b-4ffdd1748606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8484705-41e1-46b6-aff0-1cb27a023163', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea008751-3136-4fa0-aa28-74097324fd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-28725420-3d98-4617-aa0c-05882a97fa57" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:47 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Volume volume-e8484705-41e1-46b6-aff0-1cb27a023163 (e8484705-41e1-46b6-aff0-1cb27a023163): created successfully Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea008751-3136-4fa0-aa28-74097324fd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Flow 'volume_create_manager' (1c968de3-d3bf-4855-84d9-521c5c907b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-28725420-3d98-4617-aa0c-05882a97fa57" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-ea7cc42a-7e67-4ad2-bbef-7f55c1557da3" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:47 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-830492d1-a7ca-41db-9a49-e1653ec85bfb tempest-VolumesServicesTestJSON-1023256238 None] Created volume successfully. Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-ea7cc42a-7e67-4ad2-bbef-7f55c1557da3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Deleting offline snapshot ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 of volume 28725420-3d98-4617-aa0c-05882a97fa57 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:26:47 devstack sudo[85923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] snapshot_file for this snap is: volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:26:47 devstack sudo[85923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbee5ee-a3ba-4e1d-83a2-9643c81596b0]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:47 devstack sudo[85925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 Feb 26 20:26:47 devstack sudo[85925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:48 devstack sudo[85923]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.581s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:48 devstack sudo[85933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d Feb 26 20:26:48 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:48 devstack sudo[85925]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3" returned: 0 in 0.523s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28725420-3d98-4617-aa0c-05882a97fa57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf393b06-bcf5-43cc-9d94-c7dc851eb744]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:48 devstack sudo[85935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 Feb 26 20:26:48 devstack sudo[85935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Acquiring lock "cinder-e8484705-41e1-46b6-aff0-1cb27a023163-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Lock "cinder-e8484705-41e1-46b6-aff0-1cb27a023163-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Acquiring lock "cinder-quobyte-e8484705-41e1-46b6-aff0-1cb27a023163" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Lock "cinder-quobyte-e8484705-41e1-46b6-aff0-1cb27a023163" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e55485-dc8a-4ccb-9db2-ba840612ce44]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e8484705-41e1-46b6-aff0-1cb27a023163 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:48 devstack sudo[85939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e8484705-41e1-46b6-aff0-1cb27a023163 Feb 26 20:26:48 devstack sudo[85939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:48 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d" returned: 0 in 0.551s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:48 devstack sudo[85944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d Feb 26 20:26:48 devstack sudo[85944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:48 devstack sudo[85935]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57" returned: 0 in 0.564s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:48 devstack sudo[85947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 Feb 26 20:26:48 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:48 devstack sudo[85939]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e8484705-41e1-46b6-aff0-1cb27a023163" returned: 0 in 0.554s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e8484705-41e1-46b6-aff0-1cb27a023163 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:49 devstack sudo[85956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e8484705-41e1-46b6-aff0-1cb27a023163 Feb 26 20:26:49 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:49 devstack sudo[85944]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.593cd13f-6fbc-4a99-be1d-eee2daa0af9d" returned: 0 in 0.439s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-593cd13f-6fbc-4a99-be1d-eee2daa0af9d" released by "_delete_snapshot" :: held 2.212s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" released by "delete_snapshot" :: held 2.234s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Created reservations ['27ad08ba-d67d-478f-b7d0-571b0fbf2cd1', '486765ac-7a75-4291-aef3-be46cfc9bb5b', '7e6ea42e-19fd-45bc-bd19-ef2d6191ccab', '7e94845e-6332-43ab-80a1-0e53ece0b405'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:49 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Delete snapshot completed successfully. Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5e9d4aa-192d-4f30-8543-500e1267adcc tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-593cd13f-6fbc-4a99-be1d-eee2daa0af9d-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:49 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3" returned: 0 in 0.546s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:49 devstack sudo[85962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3 Feb 26 20:26:49 devstack sudo[85962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:49 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e8484705-41e1-46b6-aff0-1cb27a023163" returned: 0 in 0.406s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Lock "cinder-quobyte-e8484705-41e1-46b6-aff0-1cb27a023163" released by "delete_volume" :: held 1.001s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Created reservations ['f6280275-cb29-4182-b618-862699b0b788', '530e8bf6-2716-4ef0-9e24-5e8df0aad167', 'b8d393dd-3dac-4c17-b0c1-5895976a4702', '8252cfa6-d60f-4c0f-8bdf-c28364e8530e'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:49 devstack sudo[85965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:26:49 devstack sudo[85965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:49 devstack sudo[85962]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57.ea7cc42a-7e67-4ad2-bbef-7f55c1557da3" returned: 0 in 0.436s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-ea7cc42a-7e67-4ad2-bbef-7f55c1557da3" released by "_delete_snapshot" :: held 2.126s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-28725420-3d98-4617-aa0c-05882a97fa57" released by "delete_snapshot" :: held 2.147s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:49 devstack cinder-volume[83352]: WARNING cinder.quota [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1343484224 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1343484224, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] Created reservations ['2b992794-bc85-4c8e-8ad8-508897f4d833', 'a1f66088-7078-4af2-bccc-8476616ec0dc', '75d914df-5ae8-43e1-9de7-22bf0fd156bf', '07b20f0f-32c9-48a5-af2f-02b0c7867461'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:49 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7a41d3aa-4d93-40cd-aca1-0b2db8c24696 tempest-GroupSnapshotsTest-358298352 None] group_snapshot 52eaf3b1-ebfe-4a8c-ac98-b04cb03f4cea: deleted successfully Feb 26 20:26:49 devstack sudo[85965]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.451s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:26:49 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Deleted volume successfully. Feb 26 20:26:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-799aa4f7-dfd3-4804-b1fe-6e64b62c3751 tempest-VolumesServicesTestJSON-1023256238 None] Lock "cinder-e8484705-41e1-46b6-aff0-1cb27a023163-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] Creating offline snapshot 7d321bde-4761-4895-9688-cb3cc1d390f6 of volume 5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:26:50 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[797380ac-ba44-4406-8fbc-c50d5cc6cb60]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:50 devstack sudo[85969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:50 devstack sudo[85969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:50 devstack sudo[85969]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.592s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:50 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 1G Feb 26 20:26:50 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:51 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-28725420-3d98-4617-aa0c-05882a97fa57" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:51 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-28725420-3d98-4617-aa0c-05882a97fa57" acquired by "delete_volume" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:51 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[082aae35-7992-476a-9928-82ea5961114c]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:51 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 Feb 26 20:26:51 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:51 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 1G" returned: 0 in 0.727s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:51 devstack sudo[86009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 Feb 26 20:26:51 devstack sudo[86009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:52 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57" returned: 0 in 0.905s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:52 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57 Feb 26 20:26:52 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:52 devstack sudo[86009]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6" returned: 0 in 0.725s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:52 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 is being set with open permissions: ugo+rw Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:52 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 Feb 26 20:26:52 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:52 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28725420-3d98-4617-aa0c-05882a97fa57" returned: 0 in 0.560s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-28725420-3d98-4617-aa0c-05882a97fa57" released by "delete_volume" :: held 1.522s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Created reservations ['c6621444-53be-425c-b983-6e6c49698a19'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:52 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6" returned: 0 in 0.587s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:52 devstack cinder-volume[83352]: WARNING cinder.db.sqlalchemy.api [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1343484224'] Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.725s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Created reservations ['7ba4f4a7-4ac9-4006-8584-68afe32178c8', '7ee8aba9-c601-4bfe-9da5-b1dba21fecf0', '7246e757-b59f-4d37-8073-66be5d376169', 'f59f3a0b-aa30-4d94-b560-c8d45ca2091b'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:52 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-4b2d5231-0321-49c1-b98e-d44682c418a9 tempest-SnapshotsActionsTest-892907791 None] Create snapshot completed successfully Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:53 devstack sudo[86023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:26:53 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Acquiring lock "cinder-7d321bde-4761-4895-9688-cb3cc1d390f6-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-7d321bde-4761-4895-9688-cb3cc1d390f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Acquiring lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Acquiring lock "cinder-quobyte-7d321bde-4761-4895-9688-cb3cc1d390f6" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-7d321bde-4761-4895-9688-cb3cc1d390f6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Deleting offline snapshot 7d321bde-4761-4895-9688-cb3cc1d390f6 of volume 5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:26:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] snapshot_file for this snap is: volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:26:53 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfde640-42aa-4c71-8f9c-a2ea14fe328b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:53 devstack sudo[86025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 Feb 26 20:26:53 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:53 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.691s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:53 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:26:53 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-fb772196-c584-4d0c-ac6f-9f588d08bf32 tempest-GroupSnapshotsTest-358298352 None] Delete group completed successfully. Feb 26 20:26:53 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-4314ef8a-0de9-464b-aebc-decdb00aeaa3 tempest-GroupSnapshotsTest-358298352 None] Group tempest-GroupSnapshotsTest-Group-1720973278: creating Feb 26 20:26:53 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-4314ef8a-0de9-464b-aebc-decdb00aeaa3 tempest-GroupSnapshotsTest-358298352 None] Group tempest-GroupSnapshotsTest-Group-1720973278: created successfully Feb 26 20:26:53 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-4314ef8a-0de9-464b-aebc-decdb00aeaa3 tempest-GroupSnapshotsTest-358298352 None] Create group completed successfully. Feb 26 20:26:54 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6" returned: 0 in 0.728s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:54 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99671d3-2948-44e4-9eda-a7eb8c3a3417]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:54 devstack sudo[86031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:54 devstack sudo[86031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:54 devstack sudo[86031]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.585s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:54 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 Feb 26 20:26:54 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:55 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6" returned: 0 in 0.540s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:55 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6 Feb 26 20:26:55 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Flow 'volume_create_manager' (3f0812ad-1448-49b7-8d5d-d763331f44c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02ac78ab-a788-4efb-ae5f-76b00320a79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02ac78ab-a788-4efb-ae5f-76b00320a79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-225606708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6324bff-b642-4be1-83f6-6bf016cb582f,host='devstack@QuobyteHD#QuobyteHD',id=cc396b6c-2dc7-4cdc-8599-581541606408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390c04c0fe474a7bb81ceff4ab32543f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:55Z,use_quota=True,user_id='53cf61d0e7fc480a85916ec98ebd8753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c3678e-16bc-46db-9584-56ec0e2a338a),volume_type_id=d7c3678e-16bc-46db-9584-56ec0e2a338a)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9642a1a8-ac7c-40ba-bf58-26097a8759bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9642a1a8-ac7c-40ba-bf58-26097a8759bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4da6e2-1693-4921-88cb-db81c955929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4da6e2-1693-4921-88cb-db81c955929e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc396b6c-2dc7-4cdc-8599-581541606408', 'volume_name': 'volume-cc396b6c-2dc7-4cdc-8599-581541606408', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61ef7bb-95b7-4d4e-bc3e-cbb68af949b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61ef7bb-95b7-4d4e-bc3e-cbb68af949b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ecf3d6-8628-469c-8b2c-1624749cf366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:55 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Volume cc396b6c-2dc7-4cdc-8599-581541606408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc396b6c-2dc7-4cdc-8599-581541606408', 'volume_size': 1} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b6324bff-b642-4be1-83f6-6bf016cb582f,created_at=2026-02-26T19:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-225606708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6324bff-b642-4be1-83f6-6bf016cb582f,host='devstack@QuobyteHD#QuobyteHD',id=cc396b6c-2dc7-4cdc-8599-581541606408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390c04c0fe474a7bb81ceff4ab32543f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:55Z,use_quota=True,user_id='53cf61d0e7fc480a85916ec98ebd8753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c3678e-16bc-46db-9584-56ec0e2a338a),volume_type_id=d7c3678e-16bc-46db-9584-56ec0e2a338a)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Creating volume cc396b6c-2dc7-4cdc-8599-581541606408 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:26:55 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:55 devstack sudo[86043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 1073741824 Feb 26 20:26:55 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:55 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.7d321bde-4761-4895-9688-cb3cc1d390f6" returned: 0 in 0.568s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-7d321bde-4761-4895-9688-cb3cc1d390f6" released by "_delete_snapshot" :: held 2.497s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" released by "delete_snapshot" :: held 2.532s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:56 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Created reservations ['e4b8e914-c3f3-4ae4-993b-4e4662c69b15', 'fe639ee4-5d56-47c0-83a4-8ab0b1d4d97a', '7a3b4d58-70d2-48b4-a3ec-d363b6ea22ae', '712905c6-f1c1-4cda-bd13-e3cd801ec21d'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:26:56 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Delete snapshot completed successfully. Feb 26 20:26:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9dca05e1-bb77-4384-837d-c077aa04c93d tempest-SnapshotsActionsTest-1939416453 None] Lock "cinder-7d321bde-4761-4895-9688-cb3cc1d390f6-delete_snapshot" released by "delete_snapshot" :: held 2.716s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:26:56 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 1073741824" returned: 0 in 0.647s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:56 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 Feb 26 20:26:56 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:56 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408" returned: 0 in 0.498s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:26:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ecf3d6-8628-469c-8b2c-1624749cf366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc396b6c-2dc7-4cdc-8599-581541606408', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9955d39-d85c-424e-97d9-a61e88965c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:56 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Volume volume-cc396b6c-2dc7-4cdc-8599-581541606408 (cc396b6c-2dc7-4cdc-8599-581541606408): created successfully Feb 26 20:26:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9955d39-d85c-424e-97d9-a61e88965c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Flow 'volume_create_manager' (3f0812ad-1448-49b7-8d5d-d763331f44c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:56 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-9aec34d1-b09f-4438-947d-c5dca4018ae5 tempest-GroupSnapshotsTest-358298352 None] Created volume successfully. Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "cinder-2fa0b1b7-66ee-4409-b190-f0d3c42158d9-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Lock "cinder-2fa0b1b7-66ee-4409-b190-f0d3c42158d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" acquired by "delete_snapshot" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "cinder-quobyte-2fa0b1b7-66ee-4409-b190-f0d3c42158d9" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Lock "cinder-quobyte-2fa0b1b7-66ee-4409-b190-f0d3c42158d9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Deleting offline snapshot 2fa0b1b7-66ee-4409-b190-f0d3c42158d9 of volume 5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] snapshot_file for this snap is: volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[4074b96f-b1f8-44a7-a6b9-f096ab929dd7]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:57 devstack sudo[86053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:57 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:57 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.695s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2e9566-9fa9-45de-893f-df391c85ec44]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:26:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:57 devstack sudo[86078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 Feb 26 20:26:57 devstack sudo[86078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Flow 'volume_create_manager' (6f6d272a-d357-4e55-9c42-43e657c8ff7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf347b13-1c6a-4d98-a261-7a6bc2d8bdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf347b13-1c6a-4d98-a261-7a6bc2d8bdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2033685538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6324bff-b642-4be1-83f6-6bf016cb582f,host='devstack@QuobyteHD#QuobyteHD',id=bc3fdf2f-b388-42c0-91d2-12fbecbc58d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390c04c0fe474a7bb81ceff4ab32543f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:58Z,use_quota=True,user_id='53cf61d0e7fc480a85916ec98ebd8753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c3678e-16bc-46db-9584-56ec0e2a338a),volume_type_id=d7c3678e-16bc-46db-9584-56ec0e2a338a)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd84588-5e47-481a-a6b5-18eebb1974c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dd84588-5e47-481a-a6b5-18eebb1974c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205a9585-6a08-42fc-b878-3becec61e1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205a9585-6a08-42fc-b878-3becec61e1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc3fdf2f-b388-42c0-91d2-12fbecbc58d8', 'volume_name': 'volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376c0949-3722-4236-9300-f0fa79e509f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376c0949-3722-4236-9300-f0fa79e509f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eff6c7a-d5d3-484a-a92b-e3a0f13a9272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:58 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Volume bc3fdf2f-b388-42c0-91d2-12fbecbc58d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8', 'volume_size': 1} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b6324bff-b642-4be1-83f6-6bf016cb582f,created_at=2026-02-26T19:26:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2033685538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6324bff-b642-4be1-83f6-6bf016cb582f,host='devstack@QuobyteHD#QuobyteHD',id=bc3fdf2f-b388-42c0-91d2-12fbecbc58d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390c04c0fe474a7bb81ceff4ab32543f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:26:58Z,use_quota=True,user_id='53cf61d0e7fc480a85916ec98ebd8753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7c3678e-16bc-46db-9584-56ec0e2a338a),volume_type_id=d7c3678e-16bc-46db-9584-56ec0e2a338a)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Creating volume bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:26:58 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:58 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 1073741824 Feb 26 20:26:58 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:58 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 1073741824" returned: 0 in 0.574s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:58 devstack sudo[86078]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481" returned: 0 in 0.931s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:58 devstack sudo[86089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 Feb 26 20:26:58 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:58 devstack sudo[86091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:58 devstack sudo[86091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:26:59 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8" returned: 0 in 0.754s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:26:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:26:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eff6c7a-d5d3-484a-a92b-e3a0f13a9272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841c8805-4229-454c-aaa8-cbc31717e131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:26:59 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Volume volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 (bc3fdf2f-b388-42c0-91d2-12fbecbc58d8): created successfully Feb 26 20:26:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (841c8805-4229-454c-aaa8-cbc31717e131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:26:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Flow 'volume_create_manager' (6f6d272a-d357-4e55-9c42-43e657c8ff7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:26:59 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d83afdf3-4a5e-4f6c-9c95-9412f2292e1a tempest-GroupSnapshotsTest-358298352 None] Created volume successfully. Feb 26 20:26:59 devstack sudo[86091]: pam_unix(sudo:session): session closed for user root Feb 26 20:26:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.848s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:26:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:26:59 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9 Feb 26 20:26:59 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:00 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481.2fa0b1b7-66ee-4409-b190-f0d3c42158d9" returned: 0 in 0.532s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Lock "cinder-quobyte-2fa0b1b7-66ee-4409-b190-f0d3c42158d9" released by "_delete_snapshot" :: held 3.113s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" released by "delete_snapshot" :: held 3.136s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:00 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Created reservations ['d4a4ccc6-6c3a-468d-9009-bc5a867bc129', '1347664e-644e-42d7-ba49-35d2df715d19', '32809ef2-8944-454c-b642-16f7f9d0071b', '9d4ee383-7be3-4b5d-984a-5ffb9d56f299'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:00 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Delete snapshot completed successfully. Feb 26 20:27:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f880b665-a185-4f04-a199-e877f095d5cd tempest-SnapshotsActionsTest-892907791 None] Lock "cinder-2fa0b1b7-66ee-4409-b190-f0d3c42158d9-delete_snapshot" released by "delete_snapshot" :: held 3.254s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:00 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-753b0169-2f31-450e-abc1-dc6dba404f4b tempest-GroupSnapshotsTest-358298352 None] Update group completed successfully. Feb 26 20:27:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "cinder-5fd10df1-ada0-4086-aa19-f4dd1a71e481-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Lock "cinder-5fd10df1-ada0-4086-aa19-f4dd1a71e481-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" acquired by "delete_volume" :: waited 0.007s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:01 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fc1205-aeb6-4c2a-aff3-c72db892fa48]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:01 devstack sudo[86101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 Feb 26 20:27:01 devstack sudo[86101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:01 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f89a9219-b5c1-4cdc-a18d-a6e1703de154 tempest-GroupSnapshotsTest-358298352 None] Update group completed successfully. Feb 26 20:27:02 devstack sudo[86101]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481" returned: 0 in 0.775s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:02 devstack sudo[86106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481 Feb 26 20:27:02 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:02 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-939f18c8-12ad-46fa-89f2-826829033f59 tempest-GroupSnapshotsTest-358298352 None] Update group completed successfully. Feb 26 20:27:02 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5fd10df1-ada0-4086-aa19-f4dd1a71e481" returned: 0 in 0.620s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Lock "cinder-quobyte-5fd10df1-ada0-4086-aa19-f4dd1a71e481" released by "delete_volume" :: held 1.463s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:02 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Created reservations ['7fece95c-1c81-4838-b5dd-0a16586b39b2', 'ec7255bb-57dd-48f5-adea-242c68023a61', '97a1e9db-0e22-4354-a25e-e89804837846', 'f916854d-5647-4d99-b9cc-b0411b3695cb'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:02 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:02 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:03 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:27:03 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Flow 'volume_create_manager' (a7b399d6-e303-470a-bc01-4e7f84210503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a4cff2-c944-4d9d-a038-a27a06103440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a4cff2-c944-4d9d-a038-a27a06103440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1812383665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433ac829-57c8-406c-9107-e031262a9ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a3b59e040c4f949fda24bc5f9ca1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:03Z,use_quota=True,user_id='0616db97fafe4d969a4c4790610fd997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:03 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b70697-9b54-43d7-9678-0ced621e98aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b70697-9b54-43d7-9678-0ced621e98aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5193801f-cf6c-42a4-930d-7d1ddb3e47b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.image.glance [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Creating Keystone auth plugin from conf {{(pid=83352) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.532s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:27:03 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Deleted volume successfully. Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d28d45c5-ce68-4ba5-89fd-a36123b83e05 tempest-SnapshotsActionsTest-892907791 None] Lock "cinder-5fd10df1-ada0-4086-aa19-f4dd1a71e481-delete_volume" released by "delete_volume" :: held 2.125s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5193801f-cf6c-42a4-930d-7d1ddb3e47b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '433ac829-57c8-406c-9107-e031262a9ac6', 'volume_name': 'volume-433ac829-57c8-406c-9107-e031262a9ac6', 'volume_size': 1, 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9cc93d85d98d418bb1b53f2c8bbda0ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'created_at': datetime.datetime(2026, 2, 26, 19, 20, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 19, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b370d0-3b48-4e9c-84d0-dbe9fd168e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b370d0-3b48-4e9c-84d0-dbe9fd168e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e416f58-44bb-416f-8b3c-2a52b76da68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:03 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Volume 433ac829-57c8-406c-9107-e031262a9ac6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-433ac829-57c8-406c-9107-e031262a9ac6', 'volume_size': 1, 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9cc93d85d98d418bb1b53f2c8bbda0ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'created_at': datetime.datetime(2026, 2, 26, 19, 20, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 19, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 26 20:27:03 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Trying to clone 433ac829-57c8-406c-9107-e031262a9ac6 from image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]). {{(pid=83352) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 26 20:27:04 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d8ceab05-3757-4b17-a8be-062b9aff90c0 tempest-GroupSnapshotsTest-358298352 None] Update group completed successfully. Feb 26 20:27:04 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83352) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 26 20:27:04 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Image download 20.69 MB at 20.69 MB/s Feb 26 20:27:04 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eb2779-1024-46d2-91f1-96669a239d0d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:04 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD Feb 26 20:27:04 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:04 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD" returned: 0 in 0.513s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:04 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Temporary image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 is fetched for user 0616db97fafe4d969a4c4790610fd997. {{(pid=83352) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 26 20:27:04 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e756f62-55a6-4ac5-b03f-3ef005ccd14f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:04 devstack sudo[86143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD Feb 26 20:27:04 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:05 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] GroupSnapshot 2a576d62-6fe1-40f0-8a2b-078ea956ee7d: creating. Feb 26 20:27:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Group snapshot 2a576d62-6fe1-40f0-8a2b-078ea956ee7d: creating. {{(pid=83352) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 26 20:27:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:05 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Creating offline snapshot 5500cec3-4b42-4153-bb76-e515713173ed of volume bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:27:05 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dff80cb-a772-460b-b46c-ebf599727347]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:05 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD" returned: 0 in 0.692s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:05 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 Feb 26 20:27:05 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:05 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8" returned: 0 in 0.580s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:05 devstack sudo[86153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed 1G Feb 26 20:27:05 devstack sudo[86153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:06 devstack sudo[86153]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed 1G" returned: 0 in 0.608s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:06 devstack sudo[86158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed Feb 26 20:27:06 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:07 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed" returned: 0 in 0.594s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:07 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed is being set with open permissions: ugo+rw: NotImplementedError Feb 26 20:27:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:07 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed Feb 26 20:27:07 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:07 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed" returned: 0 in 0.607s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:07 devstack sudo[86167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.info Feb 26 20:27:07 devstack sudo[86167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:08 devstack sudo[86167]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.info" returned: 0 in 0.704s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:08 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.info is being set with open permissions: ugo+rw: NotImplementedError Feb 26 20:27:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:08 devstack sudo[86170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.info Feb 26 20:27:08 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Flow 'volume_create_manager' (4cf62fcd-ca11-41cf-8d18-904561a49d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868f5694-fd9f-4f8c-b062-dd31c71c7708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:09 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868f5694-fd9f-4f8c-b062-dd31c71c7708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:09Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6acc88a-0979-4797-9d07-30c26ac54754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd0cbdcb0a242009db16bae560e4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:09Z,use_quota=True,user_id='014e7c1663aa45e7a8d3e748497e8356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e979bb-ece8-492b-81aa-1cf9b4a2cd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1e979bb-ece8-492b-81aa-1cf9b4a2cd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3540deeb-d5f2-4393-a104-d99988b12598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.image.glance [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Creating Keystone auth plugin from conf {{(pid=83352) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.info" returned: 0 in 0.600s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.789s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Creating offline snapshot a200a584-0703-4a3b-9887-264ce2b7110f of volume cc396b6c-2dc7-4cdc-8599-581541606408 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd99e0-4d17-424a-aad7-adaffe74e364]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:09 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 Feb 26 20:27:09 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3540deeb-d5f2-4393-a104-d99988b12598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a6acc88a-0979-4797-9d07-30c26ac54754', 'volume_name': 'volume-a6acc88a-0979-4797-9d07-30c26ac54754', 'volume_size': 1, 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9cc93d85d98d418bb1b53f2c8bbda0ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'created_at': datetime.datetime(2026, 2, 26, 19, 20, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 19, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87fb5312-0aed-4d39-983c-7f942fff605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87fb5312-0aed-4d39-983c-7f942fff605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d78aaf-0d3a-42e3-a8b5-f363bcca67d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:09 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Volume a6acc88a-0979-4797-9d07-30c26ac54754: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a6acc88a-0979-4797-9d07-30c26ac54754', 'volume_size': 1, 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9cc93d85d98d418bb1b53f2c8bbda0ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'created_at': datetime.datetime(2026, 2, 26, 19, 20, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 19, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Trying to clone a6acc88a-0979-4797-9d07-30c26ac54754 from image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]). {{(pid=83352) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83352) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 26 20:27:09 devstack cinder-volume[83352]: INFO cinder.image.image_utils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Image download 20.69 MB at 20.69 MB/s Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ef6cfa-4ea6-4e2d-bf10-5a4bebe64a03]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:09 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD Feb 26 20:27:09 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:09 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408" returned: 0 in 0.783s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:09 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f 1G Feb 26 20:27:09 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:10 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD" returned: 0 in 0.648s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:10 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Temporary image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 is fetched for user 014e7c1663aa45e7a8d3e748497e8356. {{(pid=83352) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 26 20:27:10 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e9b535-3085-4fa0-b926-e4d37442439f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:10 devstack sudo[86191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD Feb 26 20:27:10 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:10 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f 1G" returned: 0 in 0.621s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc396b6c-2dc7-4cdc-8599-581541606408 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:10 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc396b6c-2dc7-4cdc-8599-581541606408 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f Feb 26 20:27:10 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:11 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD" returned: 0 in 0.649s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:11 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc396b6c-2dc7-4cdc-8599-581541606408 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f" returned: 0 in 0.564s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:11 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f is being set with open permissions: ugo+rw: NotImplementedError Feb 26 20:27:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:11 devstack sudo[86202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f Feb 26 20:27:11 devstack sudo[86202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:11 devstack sudo[86202]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f" returned: 0 in 0.592s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:11 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.info Feb 26 20:27:11 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:12 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.info" returned: 0 in 0.521s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:12 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.info is being set with open permissions: ugo+rw: NotImplementedError Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:12 devstack sudo[86209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.info Feb 26 20:27:12 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Flow 'volume_create_manager' (dd8c5a6e-62d4-4ccc-921f-ebe0b86bd44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cadeb7-6454-4a58-b5af-0ce0bc79610a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cadeb7-6454-4a58-b5af-0ce0bc79610a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1833127705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a446f707-a15f-4a8e-af3d-f06fc5fc79fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e255128a1ed4d23827691c686b7d83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:12Z,use_quota=True,user_id='f5abba377faf406aa0becfb74cb40d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331a896f-6c78-4cc4-8b86-6e2e3e0dabff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331a896f-6c78-4cc4-8b86-6e2e3e0dabff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a140deb9-129b-416b-8fc1-dc8d5bab1326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a140deb9-129b-416b-8fc1-dc8d5bab1326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a446f707-a15f-4a8e-af3d-f06fc5fc79fe', 'volume_name': 'volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd5c95e-7d0b-4143-a963-111e655d505a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd5c95e-7d0b-4143-a963-111e655d505a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82fefb62-aa0d-44bf-8f2d-b2a2677ad9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:12 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Volume a446f707-a15f-4a8e-af3d-f06fc5fc79fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe', 'volume_size': 1} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:12 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.info" returned: 0 in 0.502s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.641s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.361s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1812383665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=433ac829-57c8-406c-9107-e031262a9ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a3b59e040c4f949fda24bc5f9ca1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:03Z,use_quota=True,user_id='0616db97fafe4d969a4c4790610fd997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Creating volume 433ac829-57c8-406c-9107-e031262a9ac6 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:27:12 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:27:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:12 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 1073741824 Feb 26 20:27:12 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:12 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0eaa278c-febf-40bc-8955-26268744d5db tempest-GroupSnapshotsTest-358298352 None] group_snapshot 2a576d62-6fe1-40f0-8a2b-078ea956ee7d: created successfully Feb 26 20:27:13 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 1073741824" returned: 0 in 0.531s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:13 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 Feb 26 20:27:13 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:13 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] group_snapshot 2a576d62-6fe1-40f0-8a2b-078ea956ee7d: deleting Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] group_snapshot 2a576d62-6fe1-40f0-8a2b-078ea956ee7d: deleting {{(pid=83352) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 26 20:27:13 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6" returned: 0 in 0.501s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.801s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:09Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6acc88a-0979-4797-9d07-30c26ac54754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bd0cbdcb0a242009db16bae560e4267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:09Z,use_quota=True,user_id='014e7c1663aa45e7a8d3e748497e8356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Creating volume a6acc88a-0979-4797-9d07-30c26ac54754 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:27:13 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:13 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 1073741824 Feb 26 20:27:13 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-5500cec3-4b42-4153-bb76-e515713173ed" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.volume.volume_utils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Attempting download of 8dcf692b-f75b-4a29-963c-f59ebe841cf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}])) to volume 433ac829-57c8-406c-9107-e031262a9ac6. {{(pid=83352) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-5500cec3-4b42-4153-bb76-e515713173ed" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Deleting offline snapshot 5500cec3-4b42-4153-bb76-e515713173ed of volume bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] snapshot_file for this snap is: volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18f4e11-8655-4672-9bc7-8a477a208699]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d323fa9-a545-40e1-ba7b-35fa39d1edaf]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_4rgfpf7m {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:14 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_4rgfpf7m Feb 26 20:27:14 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:14 devstack sudo[86231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed Feb 26 20:27:14 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:14 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 1073741824" returned: 0 in 0.571s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:14 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_4rgfpf7m" returned: 0 in 0.541s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_4rgfpf7m {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:14 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed" returned: 0 in 0.633s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:27:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:14 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5b33ae-63e8-402e-80d5-8cd9069216b5]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:14 devstack sudo[86280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_4rgfpf7m Feb 26 20:27:14 devstack sudo[86280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:14 devstack sudo[86281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 Feb 26 20:27:14 devstack sudo[86281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:14 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 Feb 26 20:27:14 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:15 devstack sudo[86281]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754" returned: 0 in 0.494s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.654s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1833127705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a446f707-a15f-4a8e-af3d-f06fc5fc79fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e255128a1ed4d23827691c686b7d83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:12Z,use_quota=True,user_id='f5abba377faf406aa0becfb74cb40d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Creating volume a446f707-a15f-4a8e-af3d-f06fc5fc79fe {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:27:15 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG cinder.volume.volume_utils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Attempting download of 8dcf692b-f75b-4a29-963c-f59ebe841cf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}])) to volume a6acc88a-0979-4797-9d07-30c26ac54754. {{(pid=83352) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 26 20:27:15 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8" returned: 0 in 0.580s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:15 devstack sudo[86292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe 1073741824 Feb 26 20:27:15 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:15 devstack sudo[86280]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_4rgfpf7m" returned: 1 in 0.685s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:15 devstack sudo[86294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_4rgfpf7m' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:27:15 devstack sudo[86294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d49f0-7f64-4d06-9eca-057fe3ac7f57]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a98ead-a146-4a8a-8657-cf77520989cb]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_kakuzhmt {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:15 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD Feb 26 20:27:15 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:15 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_kakuzhmt Feb 26 20:27:15 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:15 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe 1073741824" returned: 0 in 0.633s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:15 devstack sudo[86294]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed" returned: 0 in 0.617s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:15 devstack sudo[86309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed Feb 26 20:27:15 devstack sudo[86309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:15 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:15 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe Feb 26 20:27:15 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_kakuzhmt" returned: 0 in 0.616s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_kakuzhmt {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:15 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_kakuzhmt Feb 26 20:27:15 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:16 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD" returned: 0 in 0.783s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] 8dcf692b-f75b-4a29-963c-f59ebe841cf3 was qcow2, converting to raw {{(pid=83352) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:16 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 Feb 26 20:27:16 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:16 devstack sudo[86309]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8.5500cec3-4b42-4153-bb76-e515713173ed" returned: 0 in 0.473s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-5500cec3-4b42-4153-bb76-e515713173ed" released by "_delete_snapshot" :: held 2.368s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8" released by "delete_snapshot" :: held 2.391s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-cc396b6c-2dc7-4cdc-8599-581541606408" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-cc396b6c-2dc7-4cdc-8599-581541606408" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-a200a584-0703-4a3b-9887-264ce2b7110f" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-a200a584-0703-4a3b-9887-264ce2b7110f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Deleting offline snapshot a200a584-0703-4a3b-9887-264ce2b7110f of volume cc396b6c-2dc7-4cdc-8599-581541606408 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] snapshot_file for this snap is: volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8e0894-5a83-4bc8-a147-6b7b69f3d057]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:16 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f Feb 26 20:27:16 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:16 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe" returned: 0 in 0.783s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82fefb62-aa0d-44bf-8f2d-b2a2677ad9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da071ba-249b-4167-82b1-7ec5d175dd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:16 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Volume volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe (a446f707-a15f-4a8e-af3d-f06fc5fc79fe): created successfully Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0da071ba-249b-4167-82b1-7ec5d175dd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Flow 'volume_create_manager' (dd8c5a6e-62d4-4ccc-921f-ebe0b86bd44c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:16 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1496d882-7928-4646-8e2f-967ee497ca08 tempest-VolumeQuotasAdminTestJSON-911664506 None] Created volume successfully. Feb 26 20:27:16 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_kakuzhmt" returned: 1 in 0.845s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_kakuzhmt' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c2ba3a-dfcf-4dcf-ab64-1176adc3d5d8]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:16 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD Feb 26 20:27:16 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:17 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6" returned: 0 in 1.070s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_8gkcuiofdevstack@QuobyteHD, size 112.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:27:17 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Converted 112.00 MB image at 104.52 MB/s Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:17 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 1G Feb 26 20:27:17 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:17 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f" returned: 0 in 0.732s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc396b6c-2dc7-4cdc-8599-581541606408(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f3f9a4-db8a-4432-a758-5f8eeb1de189]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:17 devstack sudo[86337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 Feb 26 20:27:17 devstack sudo[86337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:17 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD" returned: 0 in 0.600s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] 8dcf692b-f75b-4a29-963c-f59ebe841cf3 was qcow2, converting to raw {{(pid=83352) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:17 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 Feb 26 20:27:17 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:17 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 1G" returned: 0 in 0.495s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a9063e-79e9-4f71-aa5b-d092e8c0a5af]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:17 devstack sudo[86337]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408" returned: 0 in 0.536s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:17 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f Feb 26 20:27:17 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:17 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 Feb 26 20:27:17 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Acquiring lock "cinder-a446f707-a15f-4a8e-af3d-f06fc5fc79fe-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "cinder-a446f707-a15f-4a8e-af3d-f06fc5fc79fe-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Acquiring lock "cinder-quobyte-a446f707-a15f-4a8e-af3d-f06fc5fc79fe" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "cinder-quobyte-a446f707-a15f-4a8e-af3d-f06fc5fc79fe" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d44264-2c78-4ad8-8528-e14cc03dd43f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:18 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe Feb 26 20:27:18 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:18 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6" returned: 0 in 0.735s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:18 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f" returned: 0 in 0.754s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:18 devstack sudo[86381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f Feb 26 20:27:18 devstack sudo[86381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:18 devstack sudo[86380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 Feb 26 20:27:18 devstack sudo[86380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:18 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754" returned: 0 in 1.323s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:18 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_2i6_wx3qdevstack@QuobyteHD, size 112.00 MB, duration 1.32 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:27:18 devstack cinder-volume[83352]: INFO cinder.image.image_utils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Converted 112.00 MB image at 84.56 MB/s Feb 26 20:27:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:18 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 1G Feb 26 20:27:18 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:18 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe" returned: 0 in 0.716s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:18 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe Feb 26 20:27:18 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:19 devstack sudo[86380]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6" returned: 1 in 0.728s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.volume.volume_utils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Downloaded image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}])) to volume 433ac829-57c8-406c-9107-e031262a9ac6 successfully. {{(pid=83352) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Temporary image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 for user 0616db97fafe4d969a4c4790610fd997 is deleted. {{(pid=83352) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.volume.volume_utils [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Marking volume 433ac829-57c8-406c-9107-e031262a9ac6 as bootable. {{(pid=83352) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 26 20:27:19 devstack sudo[86381]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408.a200a584-0703-4a3b-9887-264ce2b7110f" returned: 0 in 0.651s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-a200a584-0703-4a3b-9887-264ce2b7110f" released by "_delete_snapshot" :: held 2.748s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Copying metadata from image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 to 433ac829-57c8-406c-9107-e031262a9ac6. {{(pid=83352) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Creating volume glance metadata for volume 433ac829-57c8-406c-9107-e031262a9ac6 backed by image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83352) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-cc396b6c-2dc7-4cdc-8599-581541606408" released by "delete_snapshot" :: held 2.777s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:19 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 1G" returned: 0 in 0.605s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:19 devstack cinder-volume[83352]: WARNING cinder.quota [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-875475792 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-875475792, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:27:19 devstack cinder-volume[83352]: WARNING cinder.quota [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-875475792 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-875475792, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Created reservations ['2025ee24-0d43-40c5-bbbb-ae44435a2b4c', 'd15b9cc5-ccb5-438e-8b82-a198d2b08953', 'a9c173c6-566c-47bf-946f-149d49dc7279', '2debee5c-853b-4c75-961f-baab28ca6b57'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[66280dbd-8335-4180-98a8-3d53c8b12452]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:19 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e416f58-44bb-416f-8b3c-2a52b76da68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-433ac829-57c8-406c-9107-e031262a9ac6', 'volume_size': 1, 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9cc93d85d98d418bb1b53f2c8bbda0ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'created_at': datetime.datetime(2026, 2, 26, 19, 20, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 19, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cec0b6-5d5d-4d9c-997b-353cb86fa627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a446f707-a15f-4a8e-af3d-f06fc5fc79fe" returned: 0 in 0.683s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:19 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Volume volume-433ac829-57c8-406c-9107-e031262a9ac6 (433ac829-57c8-406c-9107-e031262a9ac6): created successfully Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cec0b6-5d5d-4d9c-997b-353cb86fa627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Flow 'volume_create_manager' (a7b399d6-e303-470a-bc01-4e7f84210503) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "cinder-quobyte-a446f707-a15f-4a8e-af3d-f06fc5fc79fe" released by "delete_volume" :: held 1.436s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:19 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0f0e6892-6ad1-483e-8e60-327c078a8132 tempest-VolumesImageMetadata-2021341492 None] Created volume successfully. Feb 26 20:27:19 devstack sudo[86400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 Feb 26 20:27:19 devstack sudo[86400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] Created reservations ['c4dba487-7791-45c7-83c3-513ab5689f74', '985b5e95-c636-499c-822c-920d4bb4d8a2', 'daafab42-fe6b-41d5-a409-1b8662cad38f', '29992bc6-e55c-4e02-aa53-cbac310cf7fc'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Created reservations ['798ec28d-5639-42c2-a58e-451f2cceff46', '094c1c9b-4574-4feb-aeda-657b679c890e', '697311b2-058c-400b-9c27-7eee23b7a83b', 'b6c4dbdf-337f-4775-b41c-61d1cedf5eb0'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:19 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7c4bc393-904c-4f99-9d98-47270f90d55c tempest-GroupSnapshotsTest-358298352 None] group_snapshot 2a576d62-6fe1-40f0-8a2b-078ea956ee7d: deleted successfully Feb 26 20:27:19 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:27:19 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Acquiring lock "cinder-433ac829-57c8-406c-9107-e031262a9ac6-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Lock "cinder-433ac829-57c8-406c-9107-e031262a9ac6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:19 devstack sudo[86400]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754" returned: 0 in 0.559s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Acquiring lock "cinder-quobyte-433ac829-57c8-406c-9107-e031262a9ac6" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Lock "cinder-quobyte-433ac829-57c8-406c-9107-e031262a9ac6" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0eec2a-8a08-48fe-8921-ba518a723dc9]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:19 devstack sudo[86407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 Feb 26 20:27:19 devstack sudo[86407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:19 devstack sudo[86408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 Feb 26 20:27:19 devstack sudo[86408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:20 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.558s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:27:20 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Deleted volume successfully. Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7587a1c6-b860-487e-9501-25ab47e3fb9b tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "cinder-a446f707-a15f-4a8e-af3d-f06fc5fc79fe-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:27:20 devstack sudo[86407]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Flow 'volume_create_manager' (3956f97c-247a-4b4a-b77e-18ec7fe02ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562f6044-ad6b-47ad-b0c3-e9ed012d7db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754" returned: 1 in 0.868s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.volume_utils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Downloaded image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}])) to volume a6acc88a-0979-4797-9d07-30c26ac54754 successfully. {{(pid=83352) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Temporary image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 for user 014e7c1663aa45e7a8d3e748497e8356 is deleted. {{(pid=83352) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.volume_utils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Marking volume a6acc88a-0979-4797-9d07-30c26ac54754 as bootable. {{(pid=83352) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (562f6044-ad6b-47ad-b0c3-e9ed012d7db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1936425453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368440f0-ec5b-4c6e-8bc2-90fab9016d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e255128a1ed4d23827691c686b7d83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:21Z,use_quota=True,user_id='f5abba377faf406aa0becfb74cb40d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e26e46b-659e-45ab-b776-e0e78337848d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e26e46b-659e-45ab-b776-e0e78337848d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c729ce-7b9b-4eb4-9afd-d47331460561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c729ce-7b9b-4eb4-9afd-d47331460561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '368440f0-ec5b-4c6e-8bc2-90fab9016d3d', 'volume_name': 'volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2338d581-b2b2-4912-9b28-d7648069617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2338d581-b2b2-4912-9b28-d7648069617e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0b9b6d-4a92-416b-89a3-40e68e679a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:20 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Volume 368440f0-ec5b-4c6e-8bc2-90fab9016d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d', 'volume_size': 1} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1936425453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368440f0-ec5b-4c6e-8bc2-90fab9016d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e255128a1ed4d23827691c686b7d83e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:21Z,use_quota=True,user_id='f5abba377faf406aa0becfb74cb40d85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Creating volume 368440f0-ec5b-4c6e-8bc2-90fab9016d3d {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:20 devstack sudo[86408]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:27:20 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Copying metadata from image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 to a6acc88a-0979-4797-9d07-30c26ac54754. {{(pid=83352) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Creating volume glance metadata for volume a6acc88a-0979-4797-9d07-30c26ac54754 backed by image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83352) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 26 20:27:20 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d 1073741824 Feb 26 20:27:20 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6" returned: 0 in 0.885s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8" acquired by "delete_volume" :: waited 0.026s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c555e040-39c5-4190-9a19-103680cb744d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:20 devstack sudo[86419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 Feb 26 20:27:20 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d78aaf-0d3a-42e3-a8b5-f363bcca67d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6acc88a-0979-4797-9d07-30c26ac54754', 'volume_size': 1, 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9cc93d85d98d418bb1b53f2c8bbda0ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'created_at': datetime.datetime(2026, 2, 26, 19, 20, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 19, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e4e986-8d15-4575-b611-14dafdec69a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:20 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Volume volume-a6acc88a-0979-4797-9d07-30c26ac54754 (a6acc88a-0979-4797-9d07-30c26ac54754): created successfully Feb 26 20:27:20 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 Feb 26 20:27:20 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e4e986-8d15-4575-b611-14dafdec69a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Flow 'volume_create_manager' (4cf62fcd-ca11-41cf-8d18-904561a49d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:21 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-071f4810-87c0-40d8-b6a4-317c4abcc433 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Created volume successfully. Feb 26 20:27:21 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6" returned: 1 in 0.598s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:27:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:21 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d 1073741824" returned: 0 in 0.654s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:21 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6 Feb 26 20:27:21 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:21 devstack sudo[86434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d Feb 26 20:27:21 devstack sudo[86434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:21 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8" returned: 0 in 0.675s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:21 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8 Feb 26 20:27:21 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-30e815a8-efee-4f2c-b2e0-58cfb4beb90a tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:22 devstack sudo[86434]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d" returned: 0 in 0.566s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-30e815a8-efee-4f2c-b2e0-58cfb4beb90a tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.244s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d0b9b6d-4a92-416b-89a3-40e68e679a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117b7009-503e-4a5d-913b-4192fb2e93e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:22 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Volume volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d (368440f0-ec5b-4c6e-8bc2-90fab9016d3d): created successfully Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117b7009-503e-4a5d-913b-4192fb2e93e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Flow 'volume_create_manager' (3956f97c-247a-4b4a-b77e-18ec7fe02ee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e628db-a711-469d-b1dc-ad5b2053a08b]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-30e815a8-efee-4f2c-b2e0-58cfb4beb90a tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:22 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-ed80afbc-81d9-4996-983b-31bb8d410550 tempest-VolumeQuotasAdminTestJSON-911664506 None] Created volume successfully. Feb 26 20:27:22 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-433ac829-57c8-406c-9107-e031262a9ac6" returned: 0 in 0.733s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Lock "cinder-quobyte-433ac829-57c8-406c-9107-e031262a9ac6" released by "delete_volume" :: held 2.266s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:22 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8" returned: 0 in 0.623s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-bc3fdf2f-b388-42c0-91d2-12fbecbc58d8" released by "delete_volume" :: held 1.335s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-cc396b6c-2dc7-4cdc-8599-581541606408" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:22 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 Feb 26 20:27:22 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-cc396b6c-2dc7-4cdc-8599-581541606408" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebf0f6b-fdcd-4cfb-a893-3003052e672c]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Created reservations ['ba29bb9c-4d3d-4731-b3c1-d36c663701b0', '7b61174a-2983-4e8a-9ac2-96bfbaf15b3d', '88a1b493-2248-4fd6-af6e-b52ed034d8dc', 'f8686d31-daaf-4055-9f6d-ebe9d49b5da3'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:22 devstack sudo[86451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 Feb 26 20:27:22 devstack sudo[86451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:22 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:27:22 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:22 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-30e815a8-efee-4f2c-b2e0-58cfb4beb90a tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754" returned: 0 in 0.501s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-30e815a8-efee-4f2c-b2e0-58cfb4beb90a tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:22 devstack sudo[86457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 Feb 26 20:27:22 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:22 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.446s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:27:22 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Deleted volume successfully. Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-97405745-93cd-4a4c-9a5a-75de0b53fbda tempest-VolumesImageMetadata-2021341492 None] Lock "cinder-433ac829-57c8-406c-9107-e031262a9ac6-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:22 devstack sudo[86451]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408" returned: 0 in 0.586s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:22 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408 Feb 26 20:27:22 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:23 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-30e815a8-efee-4f2c-b2e0-58cfb4beb90a tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754" returned: 1 in 0.643s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-30e815a8-efee-4f2c-b2e0-58cfb4beb90a tempest-ServerBootFromVolumeStableRescueTest-207809681 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-30e815a8-efee-4f2c-b2e0-58cfb4beb90a tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.187s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-30e815a8-efee-4f2c-b2e0-58cfb4beb90a tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316', 'name': 'volume-a6acc88a-0979-4797-9d07-30c26ac54754', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c671c3aa-6a15-4b4e-ba05-04a6fb63dcf4', 'enforce_multipath': True} {{(pid=83352) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Feb 26 20:27:23 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cc396b6c-2dc7-4cdc-8599-581541606408" returned: 0 in 0.496s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-cc396b6c-2dc7-4cdc-8599-581541606408" released by "delete_volume" :: held 1.131s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:23 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-121902ca-1bc5-4d98-893c-2733f870cab9 req-30e815a8-efee-4f2c-b2e0-58cfb4beb90a tempest-ServerBootFromVolumeStableRescueTest-207809681 None] attachment_update completed successfully. Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Created reservations ['da513841-738b-4984-afcd-678f55500b74'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:23 devstack cinder-volume[83352]: WARNING cinder.quota [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-875475792 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-875475792, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Created reservations ['ec2deb6e-4227-48c8-b132-d958a23416ed', '403a1eb0-febb-494a-abc1-27ab5f526e4c', '31e271a8-ec46-443c-b9f6-a4d302ada521', 'c7b16c1d-ed3a-4e8a-b1c8-e28d38f41fa7'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:23 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f7936164-d506-4ab2-b6d4-bd3e64f93d1a tempest-VolumeQuotasAdminTestJSON-1079535444 None] Transfer volume completed successfully. Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Created reservations ['37e1b19e-b1de-43d7-8b1e-733ddfb0b782', '7a5b90f4-0479-4df9-9069-1e627aee6f6a', 'ce1c3ffc-b324-412f-acfc-c18ee63c7655', 'c5ddb617-2009-4824-8659-ea5c25340b7b'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:23 devstack sudo[86469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:27:23 devstack sudo[86469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:23 devstack sudo[86469]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.442s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:23 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:27:23 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-bebfa92b-6d58-4e3a-9b88-0c10743d36b9 tempest-GroupSnapshotsTest-358298352 None] Delete group completed successfully. Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG oslo_service.periodic_task [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83352) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:24 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:27:24 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Acquiring lock "cinder-368440f0-ec5b-4c6e-8bc2-90fab9016d3d-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Lock "cinder-368440f0-ec5b-4c6e-8bc2-90fab9016d3d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Acquiring lock "cinder-quobyte-368440f0-ec5b-4c6e-8bc2-90fab9016d3d" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Lock "cinder-quobyte-368440f0-ec5b-4c6e-8bc2-90fab9016d3d" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[130597d5-353d-4d34-800a-4f156c55f78b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:24 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d Feb 26 20:27:24 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:24 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7945f9e1-8223-4b88-9198-f29c87f799f4 tempest-GroupSnapshotsTest-358298352 None] Group tempest-GroupSnapshotsTest-Group-593066683: creating Feb 26 20:27:24 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7945f9e1-8223-4b88-9198-f29c87f799f4 tempest-GroupSnapshotsTest-358298352 None] Group tempest-GroupSnapshotsTest-Group-593066683: created successfully Feb 26 20:27:24 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7945f9e1-8223-4b88-9198-f29c87f799f4 tempest-GroupSnapshotsTest-358298352 None] Create group completed successfully. Feb 26 20:27:24 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.595s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:24 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:27:25 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d" returned: 0 in 0.564s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:25 devstack sudo[86481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d Feb 26 20:27:25 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:25 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-368440f0-ec5b-4c6e-8bc2-90fab9016d3d" returned: 0 in 0.460s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Lock "cinder-quobyte-368440f0-ec5b-4c6e-8bc2-90fab9016d3d" released by "delete_volume" :: held 1.051s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:25 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Created reservations ['c7a510fe-c516-4fe3-a740-826548375e72', '06d22039-0a92-4710-8056-51b980d8b2ed', 'd1c92db3-2a41-43e8-9d5a-7383bfe2c443', '1c54ced1-1930-4f13-90c8-e1d2ca82740c'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:25 devstack sudo[86484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:27:25 devstack sudo[86484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:25 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Flow 'volume_create_manager' (cf1b9960-edf4-4958-a34a-e274ff69af89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a7395e-1f3d-4663-b2f6-e80418834bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a7395e-1f3d-4663-b2f6-e80418834bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-756297705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3923c0b9-a269-4e48-bac7-1d6d4e801fdc,host='devstack@QuobyteHD#QuobyteHD',id=424aa735-27ee-4e94-a12b-74722187f4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390c04c0fe474a7bb81ceff4ab32543f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:26Z,use_quota=True,user_id='53cf61d0e7fc480a85916ec98ebd8753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b452586-3441-4ac1-ae38-0e94bac5842f),volume_type_id=6b452586-3441-4ac1-ae38-0e94bac5842f)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621d08b5-b257-48de-8658-5d82d998bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621d08b5-b257-48de-8658-5d82d998bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c7fe46-ecc5-4974-80b9-e081684d14fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28c7fe46-ecc5-4974-80b9-e081684d14fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '424aa735-27ee-4e94-a12b-74722187f4bc', 'volume_name': 'volume-424aa735-27ee-4e94-a12b-74722187f4bc', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509b12df-dcf4-4e83-80f4-ac552fd8658d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (509b12df-dcf4-4e83-80f4-ac552fd8658d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d242c2aa-596e-49bc-af66-4469ef8ac1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:26 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Volume 424aa735-27ee-4e94-a12b-74722187f4bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-424aa735-27ee-4e94-a12b-74722187f4bc', 'volume_size': 1} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3923c0b9-a269-4e48-bac7-1d6d4e801fdc,created_at=2026-02-26T19:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-756297705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3923c0b9-a269-4e48-bac7-1d6d4e801fdc,host='devstack@QuobyteHD#QuobyteHD',id=424aa735-27ee-4e94-a12b-74722187f4bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390c04c0fe474a7bb81ceff4ab32543f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:26Z,use_quota=True,user_id='53cf61d0e7fc480a85916ec98ebd8753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b452586-3441-4ac1-ae38-0e94bac5842f),volume_type_id=6b452586-3441-4ac1-ae38-0e94bac5842f)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Creating volume 424aa735-27ee-4e94-a12b-74722187f4bc {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:27:26 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:26 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc 1073741824 Feb 26 20:27:26 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:26 devstack sudo[86484]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.516s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:27:26 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Deleted volume successfully. Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d65d6c4c-883b-40d6-a58a-00073747cbb3 tempest-VolumeQuotasAdminTestJSON-721111914 None] Lock "cinder-368440f0-ec5b-4c6e-8bc2-90fab9016d3d-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:26 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc 1073741824" returned: 0 in 0.603s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:26 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc Feb 26 20:27:26 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:27 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc" returned: 0 in 0.558s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:27:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d242c2aa-596e-49bc-af66-4469ef8ac1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-424aa735-27ee-4e94-a12b-74722187f4bc', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e69cf58-dd50-4196-9622-7e6bc7a84880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:27 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Volume volume-424aa735-27ee-4e94-a12b-74722187f4bc (424aa735-27ee-4e94-a12b-74722187f4bc): created successfully Feb 26 20:27:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e69cf58-dd50-4196-9622-7e6bc7a84880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Flow 'volume_create_manager' (cf1b9960-edf4-4958-a34a-e274ff69af89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:27 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0907663c-952c-42ed-97bb-27f4e55c091c tempest-GroupSnapshotsTest-358298352 None] Created volume successfully. Feb 26 20:27:28 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] GroupSnapshot 900406f6-64bd-4d83-ba49-c91895fd14b9: creating. Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] Group snapshot 900406f6-64bd-4d83-ba49-c91895fd14b9: creating. {{(pid=83352) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] Creating offline snapshot 714fa788-f762-4fa7-b8a8-e94281c4513e of volume 424aa735-27ee-4e94-a12b-74722187f4bc {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af20e52-bb27-47b0-84e6-89e6a4f6043a]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Flow 'volume_create_manager' (84cb3ce2-e476-49db-9fd3-03b271e75f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2297914-dccc-4b6c-be7e-55c4e81a0ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:28 devstack sudo[86522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc Feb 26 20:27:28 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2297914-dccc-4b6c-be7e-55c4e81a0ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-873391100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3ccb23-63b0-4a5a-be41-feb45a7add4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf4b358347741f7a7087438e57b88e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:29Z,use_quota=True,user_id='1ec994c8250d4f9dbf9d1957be829008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69c6f8e-6769-408f-859c-417db3b05590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69c6f8e-6769-408f-859c-417db3b05590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8519cb89-fc3d-4c08-b42e-9c2e2d802b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8519cb89-fc3d-4c08-b42e-9c2e2d802b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c3ccb23-63b0-4a5a-be41-feb45a7add4b', 'volume_name': 'volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40add6f9-60db-4722-94c9-d70f12cedb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40add6f9-60db-4722-94c9-d70f12cedb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4be2043-4749-4be0-8e89-b3fb5d015e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:28 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Volume 4c3ccb23-63b0-4a5a-be41-feb45a7add4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b', 'volume_size': 1} Feb 26 20:27:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:29 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc" returned: 0 in 0.704s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:29 devstack sudo[86529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e 1G Feb 26 20:27:29 devstack sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:30 devstack sudo[86529]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e 1G" returned: 0 in 0.843s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-424aa735-27ee-4e94-a12b-74722187f4bc -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:30 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-424aa735-27ee-4e94-a12b-74722187f4bc -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e Feb 26 20:27:30 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:30 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-424aa735-27ee-4e94-a12b-74722187f4bc -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e" returned: 0 in 0.713s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:30 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e is being set with open permissions: ugo+rw: NotImplementedError Feb 26 20:27:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:30 devstack sudo[86539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e Feb 26 20:27:30 devstack sudo[86539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:31 devstack sudo[86539]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e" returned: 0 in 0.749s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:31 devstack sudo[86542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.info Feb 26 20:27:31 devstack sudo[86542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:32 devstack sudo[86542]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.info" returned: 0 in 0.604s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:32 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.info is being set with open permissions: ugo+rw: NotImplementedError Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:32 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.info Feb 26 20:27:32 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:32 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.info" returned: 0 in 0.522s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.219s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.957s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-873391100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c3ccb23-63b0-4a5a-be41-feb45a7add4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='daf4b358347741f7a7087438e57b88e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:29Z,use_quota=True,user_id='1ec994c8250d4f9dbf9d1957be829008',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Creating volume 4c3ccb23-63b0-4a5a-be41-feb45a7add4b {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:27:32 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:27:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:32 devstack sudo[86548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b 1073741824 Feb 26 20:27:32 devstack sudo[86548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:32 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1b66040b-2454-4e09-a261-57833047d2f2 tempest-GroupSnapshotsTest-358298352 None] group_snapshot 900406f6-64bd-4d83-ba49-c91895fd14b9: created successfully Feb 26 20:27:33 devstack sudo[86548]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b 1073741824" returned: 0 in 0.573s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:33 devstack sudo[86553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b Feb 26 20:27:33 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:33 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b" returned: 0 in 0.462s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:27:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4be2043-4749-4be0-8e89-b3fb5d015e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64716b92-9f22-4500-b120-6f12823f66a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:33 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Volume volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b (4c3ccb23-63b0-4a5a-be41-feb45a7add4b): created successfully Feb 26 20:27:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64716b92-9f22-4500-b120-6f12823f66a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Flow 'volume_create_manager' (84cb3ce2-e476-49db-9fd3-03b271e75f7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:33 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1851dc07-c6ce-4c16-ae09-2d5d26b5dd7e tempest-AbsoluteLimitsTests-508613792 None] Created volume successfully. Feb 26 20:27:34 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] group_snapshot 900406f6-64bd-4d83-ba49-c91895fd14b9: deleting Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] group_snapshot 900406f6-64bd-4d83-ba49-c91895fd14b9: deleting {{(pid=83352) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-424aa735-27ee-4e94-a12b-74722187f4bc" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-424aa735-27ee-4e94-a12b-74722187f4bc" acquired by "delete_snapshot" :: waited 0.033s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-714fa788-f762-4fa7-b8a8-e94281c4513e" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Acquiring lock "cinder-4c3ccb23-63b0-4a5a-be41-feb45a7add4b-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-714fa788-f762-4fa7-b8a8-e94281c4513e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Deleting offline snapshot 714fa788-f762-4fa7-b8a8-e94281c4513e of volume 424aa735-27ee-4e94-a12b-74722187f4bc {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] snapshot_file for this snap is: volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Lock "cinder-4c3ccb23-63b0-4a5a-be41-feb45a7add4b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c3aad3-f18c-4da5-821d-207f9020a3d5]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Acquiring lock "cinder-quobyte-4c3ccb23-63b0-4a5a-be41-feb45a7add4b" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Lock "cinder-quobyte-4c3ccb23-63b0-4a5a-be41-feb45a7add4b" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d9516c-f822-4ec2-bd25-ef240c0eab84]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:34 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e Feb 26 20:27:34 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:34 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b Feb 26 20:27:34 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:34 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b" returned: 0 in 0.569s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:34 devstack sudo[86565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b Feb 26 20:27:34 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:34 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e" returned: 0 in 0.739s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-424aa735-27ee-4e94-a12b-74722187f4bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7372d5-e2e9-4f44-9358-b864c6d04517]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:35 devstack sudo[86568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc Feb 26 20:27:35 devstack sudo[86568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:35 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c3ccb23-63b0-4a5a-be41-feb45a7add4b" returned: 0 in 0.543s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:35 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Lock "cinder-quobyte-4c3ccb23-63b0-4a5a-be41-feb45a7add4b" released by "delete_volume" :: held 1.148s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:35 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Created reservations ['4e3ce684-d299-45ae-b5c9-593d08b29c8a', '61d92f08-7ce7-45be-8245-d5a70d3556af', 'cf0d98f4-4aaa-4ef7-b796-079bb578f1f2', 'b5b62411-33fd-4062-90d1-2738ca47a6f7'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:35 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:35 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:35 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:27:35 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:35 devstack sudo[86568]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc" returned: 0 in 0.816s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:35 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e Feb 26 20:27:35 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:36 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.636s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:36 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:27:36 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Deleted volume successfully. Feb 26 20:27:36 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b4c9091f-b370-48e5-8ea3-9d49fa0528c9 tempest-AbsoluteLimitsTests-508613792 None] Lock "cinder-4c3ccb23-63b0-4a5a-be41-feb45a7add4b-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:36 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e" returned: 0 in 0.569s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:36 devstack sudo[86603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e Feb 26 20:27:36 devstack sudo[86603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:37 devstack sudo[86603]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc.714fa788-f762-4fa7-b8a8-e94281c4513e" returned: 0 in 0.709s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-714fa788-f762-4fa7-b8a8-e94281c4513e" released by "_delete_snapshot" :: held 2.914s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-424aa735-27ee-4e94-a12b-74722187f4bc" released by "delete_snapshot" :: held 2.947s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:37 devstack cinder-volume[83352]: WARNING cinder.quota [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1736236946 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1736236946, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:27:37 devstack cinder-volume[83352]: WARNING cinder.quota [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1736236946 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1736236946, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:27:37 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] Created reservations ['7d2e22e4-9a3e-4843-a6b0-1ebae0354be0', 'e6b093f5-2c7e-418c-a315-0f527651c453', 'ffcc7ce5-92e7-407f-809f-a9d3df3ec47c', '3443def6-ffc4-4030-9b4a-56bc44e0adca'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:37 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f4a9a4de-64e0-4bcc-ba8c-49d52c97125d tempest-GroupSnapshotsTest-358298352 None] group_snapshot 900406f6-64bd-4d83-ba49-c91895fd14b9: deleted successfully Feb 26 20:27:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "cinder-quobyte-424aa735-27ee-4e94-a12b-74722187f4bc" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-424aa735-27ee-4e94-a12b-74722187f4bc" acquired by "delete_volume" :: waited 0.025s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:37 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[622ba371-873a-499e-b40c-5dab8b91a8cf]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:37 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc Feb 26 20:27:37 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:38 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc" returned: 0 in 0.628s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:38 devstack sudo[86631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc Feb 26 20:27:38 devstack sudo[86631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:38 devstack sudo[86631]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-424aa735-27ee-4e94-a12b-74722187f4bc" returned: 0 in 0.600s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Lock "cinder-quobyte-424aa735-27ee-4e94-a12b-74722187f4bc" released by "delete_volume" :: held 1.270s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:39 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Created reservations ['bc06aa77-dcbb-49a7-ae51-c903a28a064c'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:39 devstack cinder-volume[83352]: WARNING cinder.quota [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1736236946 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1736236946, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:27:39 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Created reservations ['ebbc6afd-9e19-42be-b84c-97e942cdf625', '6ba6043e-208a-4260-a915-03d75d782b81', 'f744a9ad-653b-4c25-8b9b-6b917e3e8add', '0325877b-765c-428c-8569-6cf84449fea3'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:39 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:27:39 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:39 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.518s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:39 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:27:39 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e7581676-fb15-4dc3-a79f-89c536d1fb73 tempest-GroupSnapshotsTest-358298352 None] Delete group completed successfully. Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:UPDATE=174,cinder:SELECT=177,cinder:INSERT=56,cinder:DELETE=7 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=198,cinder:INSERT=62,cinder:UPDATE=210,cinder:DELETE=10 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Flow 'volume_create_manager' (b32826a2-541a-405a-b0f3-009175fcf728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eab6103-3e95-4791-89ce-4ed0535d8ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eab6103-3e95-4791-89ce-4ed0535d8ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-69465615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2970aea2-29c6-45f9-b882-58186ca5c3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6eb03895cc4f6bb3cc49fc1c443931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:43Z,use_quota=True,user_id='221571c2bd3c4f84b13a028faf783c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00078cf4-a58a-409a-8670-d722282b0782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00078cf4-a58a-409a-8670-d722282b0782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a732e88b-f524-4556-ae26-f09efdb32d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a732e88b-f524-4556-ae26-f09efdb32d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2970aea2-29c6-45f9-b882-58186ca5c3ac', 'volume_name': 'volume-2970aea2-29c6-45f9-b882-58186ca5c3ac', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c23d737-d30b-479f-bfc7-49c937553fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c23d737-d30b-479f-bfc7-49c937553fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639ca784-3ac5-4de3-a1f7-4de98b562940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:43 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Volume 2970aea2-29c6-45f9-b882-58186ca5c3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2970aea2-29c6-45f9-b882-58186ca5c3ac', 'volume_size': 1} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-69465615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2970aea2-29c6-45f9-b882-58186ca5c3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6eb03895cc4f6bb3cc49fc1c443931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:43Z,use_quota=True,user_id='221571c2bd3c4f84b13a028faf783c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Creating volume 2970aea2-29c6-45f9-b882-58186ca5c3ac {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:27:43 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:27:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2970aea2-29c6-45f9-b882-58186ca5c3ac 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:43 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2970aea2-29c6-45f9-b882-58186ca5c3ac 1073741824 Feb 26 20:27:43 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:44 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3dbce333-4801-404a-86d1-cec401da70ec tempest-GroupSnapshotsV319Test-514146282 None] Group tempest-GroupSnapshotsV319Test-Group-1846642979: creating Feb 26 20:27:44 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3dbce333-4801-404a-86d1-cec401da70ec tempest-GroupSnapshotsV319Test-514146282 None] Group tempest-GroupSnapshotsV319Test-Group-1846642979: created successfully Feb 26 20:27:44 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3dbce333-4801-404a-86d1-cec401da70ec tempest-GroupSnapshotsV319Test-514146282 None] Create group completed successfully. Feb 26 20:27:44 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2970aea2-29c6-45f9-b882-58186ca5c3ac 1073741824" returned: 0 in 0.970s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2970aea2-29c6-45f9-b882-58186ca5c3ac {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:44 devstack sudo[86677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2970aea2-29c6-45f9-b882-58186ca5c3ac Feb 26 20:27:44 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:45 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2970aea2-29c6-45f9-b882-58186ca5c3ac" returned: 0 in 0.612s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:27:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639ca784-3ac5-4de3-a1f7-4de98b562940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2970aea2-29c6-45f9-b882-58186ca5c3ac', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e8345d-6fcf-4d93-a660-0dbc9a39606e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:45 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Volume volume-2970aea2-29c6-45f9-b882-58186ca5c3ac (2970aea2-29c6-45f9-b882-58186ca5c3ac): created successfully Feb 26 20:27:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85e8345d-6fcf-4d93-a660-0dbc9a39606e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Flow 'volume_create_manager' (b32826a2-541a-405a-b0f3-009175fcf728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:45 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-69dcf87d-fec5-440a-827c-8d7f4187e75f tempest-VolumesTransfersV357Test-37607919 None] Created volume successfully. Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Flow 'volume_create_manager' (449a6cfd-9fc6-4253-80ac-027138c3db9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e93dbc8-fc95-42b0-992b-7dce832ab852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e93dbc8-fc95-42b0-992b-7dce832ab852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-575080593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f9b9ed1-415a-4ad2-a223-77b5174349cf,host='devstack@QuobyteHD#QuobyteHD',id=17937a8d-3639-40f3-9ed1-cd2a7a51bb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237d2d8f5a4348b4a3467583f4d95e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:46Z,use_quota=True,user_id='91bcc3e941784b3f88064a5c4462b2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(205c71b5-57c5-4865-8302-99b2688e6b3a),volume_type_id=205c71b5-57c5-4865-8302-99b2688e6b3a)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9511dee-8ecc-4b39-916f-b566d02dfbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9511dee-8ecc-4b39-916f-b566d02dfbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573b27c2-ed58-4195-abe5-5cb2da0d3869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (573b27c2-ed58-4195-abe5-5cb2da0d3869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17937a8d-3639-40f3-9ed1-cd2a7a51bb5a', 'volume_name': 'volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7846328-110f-48ba-b15b-4397dd569664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7846328-110f-48ba-b15b-4397dd569664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b21ec3-132c-411c-9c4d-a6f0f342bad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:46 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Volume 17937a8d-3639-40f3-9ed1-cd2a7a51bb5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a', 'volume_size': 1} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6f9b9ed1-415a-4ad2-a223-77b5174349cf,created_at=2026-02-26T19:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-575080593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f9b9ed1-415a-4ad2-a223-77b5174349cf,host='devstack@QuobyteHD#QuobyteHD',id=17937a8d-3639-40f3-9ed1-cd2a7a51bb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237d2d8f5a4348b4a3467583f4d95e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:46Z,use_quota=True,user_id='91bcc3e941784b3f88064a5c4462b2ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(205c71b5-57c5-4865-8302-99b2688e6b3a),volume_type_id=205c71b5-57c5-4865-8302-99b2688e6b3a)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Creating volume 17937a8d-3639-40f3-9ed1-cd2a7a51bb5a {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:27:46 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:27:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:46 devstack sudo[86714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a 1073741824 Feb 26 20:27:46 devstack sudo[86714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:46 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e4168ae6-b014-40bc-85c7-ef595aaac693 tempest-VolumesTransfersV357Test-1755204516 None] Transfer volume completed successfully. Feb 26 20:27:47 devstack sudo[86714]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a 1073741824" returned: 0 in 0.788s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:47 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a Feb 26 20:27:47 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Acquiring lock "cinder-2970aea2-29c6-45f9-b882-58186ca5c3ac-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Lock "cinder-2970aea2-29c6-45f9-b882-58186ca5c3ac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Acquiring lock "cinder-quobyte-2970aea2-29c6-45f9-b882-58186ca5c3ac" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Lock "cinder-quobyte-2970aea2-29c6-45f9-b882-58186ca5c3ac" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[48df62f4-c898-4f26-b33a-d151a55d1993]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2970aea2-29c6-45f9-b882-58186ca5c3ac {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:47 devstack sudo[86745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2970aea2-29c6-45f9-b882-58186ca5c3ac Feb 26 20:27:47 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:47 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a" returned: 0 in 0.587s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29b21ec3-132c-411c-9c4d-a6f0f342bad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74c4c1f3-1900-47ac-b0e4-b30f8aa6f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:47 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Volume volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a (17937a8d-3639-40f3-9ed1-cd2a7a51bb5a): created successfully Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74c4c1f3-1900-47ac-b0e4-b30f8aa6f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Flow 'volume_create_manager' (449a6cfd-9fc6-4253-80ac-027138c3db9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:47 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-ff2b3634-abf2-4eb6-b2bc-21772c576e32 tempest-GroupSnapshotsV319Test-514146282 None] Created volume successfully. Feb 26 20:27:48 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2970aea2-29c6-45f9-b882-58186ca5c3ac" returned: 0 in 0.851s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2970aea2-29c6-45f9-b882-58186ca5c3ac {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:48 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2970aea2-29c6-45f9-b882-58186ca5c3ac Feb 26 20:27:48 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:48 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] GroupSnapshot bbf5e5d0-10e8-4265-a795-ce96f06b24a7: creating. Feb 26 20:27:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] Group snapshot bbf5e5d0-10e8-4265-a795-ce96f06b24a7: creating. {{(pid=83352) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Feb 26 20:27:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] Creating offline snapshot a0e12f65-2172-4b6d-a305-5e1167c6072f of volume 17937a8d-3639-40f3-9ed1-cd2a7a51bb5a {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:27:48 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6318e8c-5046-438c-934d-9ae0c3945172]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:49 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a Feb 26 20:27:49 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:49 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2970aea2-29c6-45f9-b882-58186ca5c3ac" returned: 0 in 0.841s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Lock "cinder-quobyte-2970aea2-29c6-45f9-b882-58186ca5c3ac" released by "delete_volume" :: held 1.733s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:49 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Created reservations ['a72fa979-eeb2-4613-92a0-92dba36e5f35', '19d708e2-037a-4020-b6eb-7f6764008b9c', '28037466-9a49-4b81-8a75-371c6b44ecbe', '106f1332-9299-4e24-a7fe-04134b49640e'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:49 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:27:49 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:50 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a" returned: 0 in 1.704s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:50 devstack sudo[86808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f 1G Feb 26 20:27:50 devstack sudo[86808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:50 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 1.278s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:50 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:27:50 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Deleted volume successfully. Feb 26 20:27:50 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-15c3863e-f9fe-4aa5-ab95-3fb21779f739 tempest-VolumesTransfersV357Test-1531057939 None] Lock "cinder-2970aea2-29c6-45f9-b882-58186ca5c3ac-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Flow 'volume_create_manager' (ad7a6e70-5a23-46a1-9a8d-0ce9e4505ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c992ed55-add5-4932-bffe-12a452947137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c992ed55-add5-4932-bffe-12a452947137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1592658822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff658cb-a366-4185-a952-b09f22e34ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6eb03895cc4f6bb3cc49fc1c443931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:51Z,use_quota=True,user_id='221571c2bd3c4f84b13a028faf783c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904591b6-5b50-4703-9eca-49a4e1c481b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (904591b6-5b50-4703-9eca-49a4e1c481b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a343a8-fa93-434c-aae7-1e5230d01f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a343a8-fa93-434c-aae7-1e5230d01f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff658cb-a366-4185-a952-b09f22e34ad7', 'volume_name': 'volume-dff658cb-a366-4185-a952-b09f22e34ad7', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6273ee8b-7201-4b20-8a86-a97807236444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6273ee8b-7201-4b20-8a86-a97807236444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d2101a-5a09-4021-80b4-e976a90600fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:51 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Volume dff658cb-a366-4185-a952-b09f22e34ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff658cb-a366-4185-a952-b09f22e34ad7', 'volume_size': 1} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:51 devstack sudo[86808]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f 1G" returned: 0 in 1.113s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:51 devstack sudo[86836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f Feb 26 20:27:51 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:52 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f" returned: 0 in 0.666s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:52 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f is being set with open permissions: ugo+rw: NotImplementedError Feb 26 20:27:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:52 devstack sudo[86843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f Feb 26 20:27:52 devstack sudo[86843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:52 devstack sudo[86843]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f" returned: 0 in 0.534s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:52 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.info Feb 26 20:27:52 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:53 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.info" returned: 0 in 0.543s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:53 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.info is being set with open permissions: ugo+rw: NotImplementedError Feb 26 20:27:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:53 devstack sudo[86851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.info Feb 26 20:27:53 devstack sudo[86851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:53 devstack sudo[86851]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.info" returned: 0 in 0.516s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.207s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.879s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1592658822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff658cb-a366-4185-a952-b09f22e34ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc6eb03895cc4f6bb3cc49fc1c443931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:27:51Z,use_quota=True,user_id='221571c2bd3c4f84b13a028faf783c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Creating volume dff658cb-a366-4185-a952-b09f22e34ad7 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:27:54 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dff658cb-a366-4185-a952-b09f22e34ad7 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:54 devstack sudo[86854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dff658cb-a366-4185-a952-b09f22e34ad7 1073741824 Feb 26 20:27:54 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:54 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-067cea5a-8755-476a-bd86-3b9775f47852 tempest-GroupSnapshotsV319Test-514146282 None] group_snapshot bbf5e5d0-10e8-4265-a795-ce96f06b24a7: created successfully Feb 26 20:27:54 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-d6ec192a-8174-4e8e-bfdd-62f128922747 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Terminate volume connection completed successfully. Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-d6ec192a-8174-4e8e-bfdd-62f128922747 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Deleting attachment c671c3aa-6a15-4b4e-ba05-04a6fb63dcf4. {{(pid=83352) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 26 20:27:54 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dff658cb-a366-4185-a952-b09f22e34ad7 1073741824" returned: 0 in 0.722s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dff658cb-a366-4185-a952-b09f22e34ad7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:54 devstack sudo[86863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dff658cb-a366-4185-a952-b09f22e34ad7 Feb 26 20:27:54 devstack sudo[86863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Acquiring lock "cinder-a6acc88a-0979-4797-9d07-30c26ac54754-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "cinder-a6acc88a-0979-4797-9d07-30c26ac54754-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Acquiring lock "cinder-quobyte-a6acc88a-0979-4797-9d07-30c26ac54754" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "cinder-quobyte-a6acc88a-0979-4797-9d07-30c26ac54754" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c02734-d5d9-4183-89aa-6b5f1e4dec54]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:55 devstack sudo[86865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 Feb 26 20:27:55 devstack sudo[86865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:55 devstack sudo[86863]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dff658cb-a366-4185-a952-b09f22e34ad7" returned: 0 in 0.613s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d2101a-5a09-4021-80b4-e976a90600fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff658cb-a366-4185-a952-b09f22e34ad7', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd80fd2-76cf-42d1-bb94-1fc8345faf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:27:55 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Volume volume-dff658cb-a366-4185-a952-b09f22e34ad7 (dff658cb-a366-4185-a952-b09f22e34ad7): created successfully Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd80fd2-76cf-42d1-bb94-1fc8345faf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Flow 'volume_create_manager' (ad7a6e70-5a23-46a1-9a8d-0ce9e4505ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:27:55 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0413ba34-10e0-497c-ab82-f6ed4f72cff4 tempest-VolumesTransfersV357Test-37607919 None] Created volume successfully. Feb 26 20:27:55 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] group_snapshot bbf5e5d0-10e8-4265-a795-ce96f06b24a7: deleting Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] group_snapshot bbf5e5d0-10e8-4265-a795-ce96f06b24a7: deleting {{(pid=83352) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Acquiring lock "cinder-quobyte-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Lock "cinder-quobyte-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Acquiring lock "cinder-quobyte-a0e12f65-2172-4b6d-a305-5e1167c6072f" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Lock "cinder-quobyte-a0e12f65-2172-4b6d-a305-5e1167c6072f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Deleting offline snapshot a0e12f65-2172-4b6d-a305-5e1167c6072f of volume 17937a8d-3639-40f3-9ed1-cd2a7a51bb5a {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] snapshot_file for this snap is: volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[540e18f5-2128-4160-af4d-f24d68c8b33a]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:55 devstack sudo[86868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f Feb 26 20:27:55 devstack sudo[86868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:55 devstack sudo[86865]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754" returned: 0 in 0.747s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:56 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 Feb 26 20:27:56 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:56 devstack sudo[86868]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f" returned: 0 in 0.661s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e7bceb-456f-478b-bf59-884cfd473ffc]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:56 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a Feb 26 20:27:56 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:56 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754" returned: 1 in 0.578s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:56 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754 Feb 26 20:27:56 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Acquiring lock "cinder-dff658cb-a366-4185-a952-b09f22e34ad7-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Lock "cinder-dff658cb-a366-4185-a952-b09f22e34ad7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Acquiring lock "cinder-quobyte-dff658cb-a366-4185-a952-b09f22e34ad7" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Lock "cinder-quobyte-dff658cb-a366-4185-a952-b09f22e34ad7" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22e17b0-45c8-4bb3-957c-d3b224793339]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dff658cb-a366-4185-a952-b09f22e34ad7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:56 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dff658cb-a366-4185-a952-b09f22e34ad7 Feb 26 20:27:56 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:57 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a6acc88a-0979-4797-9d07-30c26ac54754" returned: 0 in 0.548s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "cinder-quobyte-a6acc88a-0979-4797-9d07-30c26ac54754" released by "delete_volume" :: held 1.946s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG cinder.quota [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Created reservations ['59161fef-4c4f-4aa8-ba8b-9b8edd20d296', '63c748a2-db5f-4bfd-87ed-50f7db02f907', 'c5a3e8d9-7269-4a95-b842-cef5392d4884', 'dc5a0774-10da-4366-a63c-e446a19c52cb'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:57 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a" returned: 0 in 0.776s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:57 devstack sudo[86893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f Feb 26 20:27:57 devstack sudo[86893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:57 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dff658cb-a366-4185-a952-b09f22e34ad7" returned: 0 in 0.588s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dff658cb-a366-4185-a952-b09f22e34ad7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:57 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:27:57 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:57 devstack sudo[86896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dff658cb-a366-4185-a952-b09f22e34ad7 Feb 26 20:27:57 devstack sudo[86896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:57 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.487s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG cinder.manager [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:27:57 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Deleted volume successfully. Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-511b4a2c-3896-449e-a94c-55b22602b2a5 req-fec9d93d-d091-448d-9422-8fc7fb34bce2 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "cinder-a6acc88a-0979-4797-9d07-30c26ac54754-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:57 devstack sudo[86896]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dff658cb-a366-4185-a952-b09f22e34ad7" returned: 0 in 0.528s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Lock "cinder-quobyte-dff658cb-a366-4185-a952-b09f22e34ad7" released by "delete_volume" :: held 1.143s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Created reservations ['6db3f9ab-70bf-48a6-82fd-ee1b2baf21ce', '21630806-fb3f-46b9-838f-ea50dca764ef', '2226bf53-73ed-4a99-9a67-1775ff35ebcb', '667388c5-081d-4e16-b25e-eff207cdaeba'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:57 devstack sudo[86893]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f" returned: 0 in 0.690s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:27:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:57 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f Feb 26 20:27:57 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:57 devstack sudo[86906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:27:57 devstack sudo[86906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:27:58 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a.a0e12f65-2172-4b6d-a305-5e1167c6072f" returned: 0 in 0.570s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:58 devstack sudo[86906]: pam_unix(sudo:session): session closed for user root Feb 26 20:27:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.569s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:27:58 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:27:58 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Lock "cinder-quobyte-a0e12f65-2172-4b6d-a305-5e1167c6072f" released by "_delete_snapshot" :: held 2.841s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:58 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Deleted volume successfully. Feb 26 20:27:58 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Lock "cinder-quobyte-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a" released by "delete_snapshot" :: held 2.862s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:58 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7e5c4e15-9058-4ced-bb16-0cd5402fde68 tempest-VolumesTransfersV357Test-1531057939 None] Lock "cinder-dff658cb-a366-4185-a952-b09f22e34ad7-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:27:58 devstack cinder-volume[83352]: WARNING cinder.quota [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1563241318 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1563241318, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:27:58 devstack cinder-volume[83352]: WARNING cinder.quota [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1563241318 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1563241318, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:27:58 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] Created reservations ['c62403af-dc45-4467-97a4-763709858f49', 'b5101c76-e67c-42b1-a6af-e85e6d3419b0', '9abe93cc-7105-49d3-b6df-ba3f0726da73', 'cb3e3183-3ef3-4ea1-9e2e-e9a1a3d5d70c'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:27:58 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-26af6bb1-3015-4622-8d41-85411ccddbd0 tempest-GroupSnapshotsV319Test-514146282 None] group_snapshot bbf5e5d0-10e8-4265-a795-ce96f06b24a7: deleted successfully Feb 26 20:27:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Acquiring lock "cinder-quobyte-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:27:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Lock "cinder-quobyte-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a" acquired by "delete_volume" :: waited 0.019s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:27:59 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[06035b62-a063-4f32-b157-58ffb7435817]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:27:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:27:59 devstack sudo[86912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a Feb 26 20:27:59 devstack sudo[86912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:00 devstack sudo[86912]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a" returned: 0 in 0.763s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:00 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a Feb 26 20:28:00 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:00 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a" returned: 0 in 0.621s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Lock "cinder-quobyte-17937a8d-3639-40f3-9ed1-cd2a7a51bb5a" released by "delete_volume" :: held 1.450s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:00 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Created reservations ['aabd4ffe-f918-4552-9848-1966f5859d6e'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:00 devstack cinder-volume[83352]: WARNING cinder.quota [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1563241318 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1563241318, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:28:00 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Created reservations ['5a0aa60b-311a-4d8b-9d20-859b7c65ed94', '0e3c7030-78ba-4cfb-a6f5-81cbdea629a0', 'cc227af8-7f4d-4ccb-96e9-a6a2c89a418c', '7b37934d-f30a-439a-9d71-d78c40a33091'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:00 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:00 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:01 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.569s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:01 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:01 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e7af8e99-c389-4843-a359-cdd529493bb6 tempest-GroupSnapshotsV319Test-514146282 None] Delete group completed successfully. Feb 26 20:28:05 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-5a878fb4-bf3a-42b4-8dc0-f52148f0a167 tempest-GroupsTest-39586389 None] Group tempest-Group1-663068511: creating Feb 26 20:28:05 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-5a878fb4-bf3a-42b4-8dc0-f52148f0a167 tempest-GroupsTest-39586389 None] Group tempest-Group1-663068511: created successfully Feb 26 20:28:05 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-5a878fb4-bf3a-42b4-8dc0-f52148f0a167 tempest-GroupsTest-39586389 None] Create group completed successfully. Feb 26 20:28:06 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-52c2244c-56a1-42b5-99c9-b8ab7ec0717d tempest-GroupsTest-39586389 None] Group tempest-Group2-576085154: creating Feb 26 20:28:07 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-52c2244c-56a1-42b5-99c9-b8ab7ec0717d tempest-GroupsTest-39586389 None] Group tempest-Group2-576085154: created successfully Feb 26 20:28:07 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-52c2244c-56a1-42b5-99c9-b8ab7ec0717d tempest-GroupsTest-39586389 None] Create group completed successfully. Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Flow 'volume_create_manager' (5d279b69-047d-4ca7-b735-7de7bf08b0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b24884-a22d-4a46-bc0a-3e4638c0754f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b24884-a22d-4a46-bc0a-3e4638c0754f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1350831338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56eca8a5-9222-4dde-aa7f-330b36af6bdc,host='devstack@QuobyteHD#QuobyteHD',id=a894b378-e051-4843-98e8-be36765acd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbdf5b29c61410681c4cc9171e6c411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:08Z,use_quota=True,user_id='c3dd8edc125c40528c7ace847d691988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ec6f20c-77b0-418d-8953-0070710e57d5),volume_type_id=2ec6f20c-77b0-418d-8953-0070710e57d5)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d8b358-fe14-49d9-9607-c6b707dbfc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58d8b358-fe14-49d9-9607-c6b707dbfc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60688f29-d4ca-4a72-903a-b486eb09d861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60688f29-d4ca-4a72-903a-b486eb09d861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a894b378-e051-4843-98e8-be36765acd90', 'volume_name': 'volume-a894b378-e051-4843-98e8-be36765acd90', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255797de-1d7f-4fce-9747-c37191b8dcfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255797de-1d7f-4fce-9747-c37191b8dcfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fee9644-594e-418f-8b08-0a7c023e9cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:08 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Volume a894b378-e051-4843-98e8-be36765acd90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a894b378-e051-4843-98e8-be36765acd90', 'volume_size': 1} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56eca8a5-9222-4dde-aa7f-330b36af6bdc,created_at=2026-02-26T19:28:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1350831338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56eca8a5-9222-4dde-aa7f-330b36af6bdc,host='devstack@QuobyteHD#QuobyteHD',id=a894b378-e051-4843-98e8-be36765acd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbdf5b29c61410681c4cc9171e6c411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:08Z,use_quota=True,user_id='c3dd8edc125c40528c7ace847d691988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ec6f20c-77b0-418d-8953-0070710e57d5),volume_type_id=2ec6f20c-77b0-418d-8953-0070710e57d5)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Creating volume a894b378-e051-4843-98e8-be36765acd90 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:08 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a894b378-e051-4843-98e8-be36765acd90 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:08 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a894b378-e051-4843-98e8-be36765acd90 1073741824 Feb 26 20:28:08 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:09 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a894b378-e051-4843-98e8-be36765acd90 1073741824" returned: 0 in 0.652s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a894b378-e051-4843-98e8-be36765acd90 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:09 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a894b378-e051-4843-98e8-be36765acd90 Feb 26 20:28:09 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:09 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-f723a718-4964-42ca-b310-8c99e4212cbf req-f6b09fa9-32bb-4e15-838c-f9d313532667 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Terminate volume connection completed successfully. Feb 26 20:28:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-f723a718-4964-42ca-b310-8c99e4212cbf req-f6b09fa9-32bb-4e15-838c-f9d313532667 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Deleting attachment fbd0b693-40e2-4f92-b1df-0736ee48c4e2. {{(pid=83352) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Feb 26 20:28:09 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a894b378-e051-4843-98e8-be36765acd90" returned: 0 in 0.655s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:09 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fee9644-594e-418f-8b08-0a7c023e9cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a894b378-e051-4843-98e8-be36765acd90', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532d6022-c0c2-4161-86c9-d92b91e19d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:09 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Volume volume-a894b378-e051-4843-98e8-be36765acd90 (a894b378-e051-4843-98e8-be36765acd90): created successfully Feb 26 20:28:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (532d6022-c0c2-4161-86c9-d92b91e19d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Flow 'volume_create_manager' (5d279b69-047d-4ca7-b735-7de7bf08b0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:10 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-da47a6c9-ca55-4816-a574-898c10eda269 tempest-GroupsTest-39586389 None] Created volume successfully. Feb 26 20:28:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Acquiring lock "cinder-48dbcc45-cca4-4397-80ec-694492aca0ec-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "cinder-48dbcc45-cca4-4397-80ec-694492aca0ec-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Acquiring lock "cinder-quobyte-48dbcc45-cca4-4397-80ec-694492aca0ec" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "cinder-quobyte-48dbcc45-cca4-4397-80ec-694492aca0ec" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:10 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ef56b6-ad6f-40a0-b7fa-aa0b1c45a95a]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:10 devstack sudo[87042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec Feb 26 20:28:10 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:11 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec" returned: 0 in 0.829s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:11 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec Feb 26 20:28:11 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:11 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Acquiring lock "cinder-quobyte-a894b378-e051-4843-98e8-be36765acd90" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:11 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Lock "cinder-quobyte-a894b378-e051-4843-98e8-be36765acd90" acquired by "delete_volume" :: waited 0.023s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:11 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e122961-e475-44e4-af09-77409dae8705]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a894b378-e051-4843-98e8-be36765acd90 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:11 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a894b378-e051-4843-98e8-be36765acd90 Feb 26 20:28:11 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:11 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Flow 'volume_create_manager' (ae324d27-445c-459d-a2ef-3bd5ba405ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135756f9-b1e5-4364-8900-cdaeda74369a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135756f9-b1e5-4364-8900-cdaeda74369a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-750636740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69e8238-fde6-4135-808f-7f00887f1b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572fa6a7af84918b5ba7b46e4cec020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:12Z,use_quota=True,user_id='704736cdb0ae4b1795f6c213bc2c3939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad3572d-3683-487d-9b5a-202ee5fae103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ad3572d-3683-487d-9b5a-202ee5fae103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23cf7f3f-7104-4f06-a256-19b7a0257e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23cf7f3f-7104-4f06-a256-19b7a0257e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a69e8238-fde6-4135-808f-7f00887f1b4a', 'volume_name': 'volume-a69e8238-fde6-4135-808f-7f00887f1b4a', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba781592-69a7-4c92-a0a7-5cea122c76bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:12 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba781592-69a7-4c92-a0a7-5cea122c76bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e960a8-3af2-496d-ab36-76d20285c432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:12 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Volume a69e8238-fde6-4135-808f-7f00887f1b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a69e8238-fde6-4135-808f-7f00887f1b4a', 'volume_size': 1} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-750636740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69e8238-fde6-4135-808f-7f00887f1b4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572fa6a7af84918b5ba7b46e4cec020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:12Z,use_quota=True,user_id='704736cdb0ae4b1795f6c213bc2c3939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Creating volume a69e8238-fde6-4135-808f-7f00887f1b4a {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:12 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a69e8238-fde6-4135-808f-7f00887f1b4a 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-48dbcc45-cca4-4397-80ec-694492aca0ec" returned: 0 in 1.094s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "cinder-quobyte-48dbcc45-cca4-4397-80ec-694492aca0ec" released by "delete_volume" :: held 1.985s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:12 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a69e8238-fde6-4135-808f-7f00887f1b4a 1073741824 Feb 26 20:28:12 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.quota [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Created reservations ['93301f7c-a028-4a3b-b8f2-c5bfb559e554', '24b8cbb1-7645-4754-9c41-5bc92c7c8901', 'b0023211-69ff-47df-adca-586d7ce41ac5', '6cb0ef78-9e0b-469c-acbb-bacf2a00057d'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:12 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a894b378-e051-4843-98e8-be36765acd90" returned: 0 in 1.061s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a894b378-e051-4843-98e8-be36765acd90 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:12 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:12 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:12 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a894b378-e051-4843-98e8-be36765acd90 Feb 26 20:28:12 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:12 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.554s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.manager [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:12 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Deleted volume successfully. Feb 26 20:28:12 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-f723a718-4964-42ca-b310-8c99e4212cbf req-3504f829-319f-4dc5-8ada-df60a2fe1735 tempest-ServerBootFromVolumeStableRescueTest-207809681 None] Lock "cinder-48dbcc45-cca4-4397-80ec-694492aca0ec-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:13 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a69e8238-fde6-4135-808f-7f00887f1b4a 1073741824" returned: 0 in 0.999s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a69e8238-fde6-4135-808f-7f00887f1b4a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:13 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a894b378-e051-4843-98e8-be36765acd90" returned: 0 in 0.816s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:13 devstack sudo[87066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a69e8238-fde6-4135-808f-7f00887f1b4a Feb 26 20:28:13 devstack sudo[87066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Lock "cinder-quobyte-a894b378-e051-4843-98e8-be36765acd90" released by "delete_volume" :: held 1.940s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Created reservations ['8140ea19-adc2-494d-b114-5d7da3276cac'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:13 devstack cinder-volume[83352]: WARNING cinder.quota [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1340063327 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1340063327, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:28:13 devstack cinder-volume[83352]: WARNING cinder.quota [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1340063327 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1340063327, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Created reservations ['fbca60e5-16d1-4b62-9c37-59ff27748717', '47f71b9a-89a7-4991-a6dd-d28cfe109286', '0a8a984e-7237-450e-ae15-369eb2f95494', 'cf9b9393-7593-4675-9ece-30b41cf535ad'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:13 devstack sudo[87068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:13 devstack sudo[87068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-f08f8a53-9694-414a-938f-899b8dd88aa1 tempest-GroupsTest-39586389 None] Created reservations ['52f822de-863d-4fca-b2ac-ca97bb277217'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f08f8a53-9694-414a-938f-899b8dd88aa1 tempest-GroupsTest-39586389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f08f8a53-9694-414a-938f-899b8dd88aa1 tempest-GroupsTest-39586389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f08f8a53-9694-414a-938f-899b8dd88aa1 tempest-GroupsTest-39586389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f08f8a53-9694-414a-938f-899b8dd88aa1 tempest-GroupsTest-39586389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f08f8a53-9694-414a-938f-899b8dd88aa1 tempest-GroupsTest-39586389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f08f8a53-9694-414a-938f-899b8dd88aa1 tempest-GroupsTest-39586389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:13 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:13 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:13 devstack sudo[87066]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a69e8238-fde6-4135-808f-7f00887f1b4a" returned: 0 in 0.789s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e960a8-3af2-496d-ab36-76d20285c432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a69e8238-fde6-4135-808f-7f00887f1b4a', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac8d046-9294-40e1-90eb-be0c362a734d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:14 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Volume volume-a69e8238-fde6-4135-808f-7f00887f1b4a (a69e8238-fde6-4135-808f-7f00887f1b4a): created successfully Feb 26 20:28:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aac8d046-9294-40e1-90eb-be0c362a734d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Flow 'volume_create_manager' (ae324d27-445c-459d-a2ef-3bd5ba405ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:14 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-da511eb2-3f36-4172-b644-8898d82a0d50 tempest-VolumesActionsTest-1935978933 None] Created volume successfully. Feb 26 20:28:14 devstack sudo[87068]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.748s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:14 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:14 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c9e37573-38bd-4cae-90d3-17b20d3c10d8 tempest-GroupsTest-39586389 None] Delete group completed successfully. Feb 26 20:28:14 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f08f8a53-9694-414a-938f-899b8dd88aa1 tempest-GroupsTest-39586389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.621s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:14 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-f08f8a53-9694-414a-938f-899b8dd88aa1 tempest-GroupsTest-39586389 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:14 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f08f8a53-9694-414a-938f-899b8dd88aa1 tempest-GroupsTest-39586389 None] Delete group completed successfully. Feb 26 20:28:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-cba1e1f2-14b9-4d53-af90-215f96c232ac tempest-VolumesActionsTest-1935978933 None] Acquiring lock "cinder-a69e8238-fde6-4135-808f-7f00887f1b4a" by "attach_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-cba1e1f2-14b9-4d53-af90-215f96c232ac tempest-VolumesActionsTest-1935978933 None] Lock "cinder-a69e8238-fde6-4135-808f-7f00887f1b4a" acquired by "attach_volume" :: waited 0.021s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:15 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-cba1e1f2-14b9-4d53-af90-215f96c232ac tempest-VolumesActionsTest-1935978933 None] Attaching volume a69e8238-fde6-4135-808f-7f00887f1b4a to instance 05b5497f-99ad-456a-8bce-2f3b2aed7e4a at mountpoint /dev/vdb on host None. Feb 26 20:28:15 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-cba1e1f2-14b9-4d53-af90-215f96c232ac tempest-VolumesActionsTest-1935978933 None] Attach volume completed successfully. Feb 26 20:28:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-cba1e1f2-14b9-4d53-af90-215f96c232ac tempest-VolumesActionsTest-1935978933 None] Lock "cinder-a69e8238-fde6-4135-808f-7f00887f1b4a" released by "attach_volume" :: held 0.083s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:15 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d9c47593-b757-4af2-8894-db6adfa56fee tempest-GroupsTest-39586389 None] Group tempest-GroupsTest-Group-1826591344: creating Feb 26 20:28:15 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d9c47593-b757-4af2-8894-db6adfa56fee tempest-GroupsTest-39586389 None] Group tempest-GroupsTest-Group-1826591344: created successfully Feb 26 20:28:15 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d9c47593-b757-4af2-8894-db6adfa56fee tempest-GroupsTest-39586389 None] Create group completed successfully. Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Flow 'volume_create_manager' (462fc82d-db2c-40d4-8f51-38f498a030a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ccb9b3-5d4c-4140-8d8f-3788e891fde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ccb9b3-5d4c-4140-8d8f-3788e891fde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-912744904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321c2b85-446b-475e-9a29-193ad8445edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7916d91d390f4197b0e0dd42f877a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:16Z,use_quota=True,user_id='e20a23cb162b49a7ba84a23603092e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5889ba4-ffec-4d5e-a5f6-fa6f71146d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5889ba4-ffec-4d5e-a5f6-fa6f71146d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd88c33-1c42-4644-bf3e-56ce723a8e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd88c33-1c42-4644-bf3e-56ce723a8e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321c2b85-446b-475e-9a29-193ad8445edf', 'volume_name': 'volume-321c2b85-446b-475e-9a29-193ad8445edf', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7026302b-d820-468f-bd97-9e88072e1416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7026302b-d820-468f-bd97-9e88072e1416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748f2324-8c88-43c8-868a-d57bd2e520d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:16 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Volume 321c2b85-446b-475e-9a29-193ad8445edf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321c2b85-446b-475e-9a29-193ad8445edf', 'volume_size': 1} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-912744904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321c2b85-446b-475e-9a29-193ad8445edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7916d91d390f4197b0e0dd42f877a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:16Z,use_quota=True,user_id='e20a23cb162b49a7ba84a23603092e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Creating volume 321c2b85-446b-475e-9a29-193ad8445edf {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:16 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:16 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-745f8244-fd2e-435e-96fe-401874d1f677 tempest-VolumesActionsTest-707709635 None] Terminate volume connection completed successfully. Feb 26 20:28:16 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf 1073741824 Feb 26 20:28:16 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-745f8244-fd2e-435e-96fe-401874d1f677 tempest-VolumesActionsTest-707709635 None] Acquiring lock "cinder-a69e8238-fde6-4135-808f-7f00887f1b4a-detach_volume" by "detach_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-745f8244-fd2e-435e-96fe-401874d1f677 tempest-VolumesActionsTest-707709635 None] Lock "cinder-a69e8238-fde6-4135-808f-7f00887f1b4a-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:16 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-745f8244-fd2e-435e-96fe-401874d1f677 tempest-VolumesActionsTest-707709635 None] Detaching volume a69e8238-fde6-4135-808f-7f00887f1b4a from instance 05b5497f-99ad-456a-8bce-2f3b2aed7e4a. Feb 26 20:28:16 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-745f8244-fd2e-435e-96fe-401874d1f677 tempest-VolumesActionsTest-707709635 None] Detach volume completed successfully. Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-745f8244-fd2e-435e-96fe-401874d1f677 tempest-VolumesActionsTest-707709635 None] Lock "cinder-a69e8238-fde6-4135-808f-7f00887f1b4a-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:16 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf 1073741824" returned: 0 in 0.698s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:16 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf Feb 26 20:28:16 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:16 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Flow 'volume_create_manager' (4c3867a1-0d82-4095-bf6f-6450d778fd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c178976-db47-40b5-ac71-ff3ab88dbcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c178976-db47-40b5-ac71-ff3ab88dbcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-798312693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4536d3e-9b7c-4dea-bc17-69ac495be1d7,host='devstack@QuobyteHD#QuobyteHD',id=4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbdf5b29c61410681c4cc9171e6c411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:17Z,use_quota=True,user_id='c3dd8edc125c40528c7ace847d691988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78e4b1f4-3a02-4078-9df2-1825145dc671),volume_type_id=78e4b1f4-3a02-4078-9df2-1825145dc671)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936e864c-fcac-4d4a-9ef7-dd643ae0caa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936e864c-fcac-4d4a-9ef7-dd643ae0caa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad066338-d9ca-4776-b35a-2ea5a63637d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad066338-d9ca-4776-b35a-2ea5a63637d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4', 'volume_name': 'volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed64d5a-ceca-48b0-9135-ddaabb4a9aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed64d5a-ceca-48b0-9135-ddaabb4a9aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bfc9c8-e5f6-4779-ad10-fbb71424aa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:17 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Volume 4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4', 'volume_size': 1} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-024e079a-e36c-40e2-bfb6-b030894856c6 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "cinder-a69e8238-fde6-4135-808f-7f00887f1b4a-detach_volume" by "detach_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-024e079a-e36c-40e2-bfb6-b030894856c6 tempest-VolumesActionsTest-1935978933 None] Lock "cinder-a69e8238-fde6-4135-808f-7f00887f1b4a-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:17 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-024e079a-e36c-40e2-bfb6-b030894856c6 tempest-VolumesActionsTest-1935978933 None] Volume detach called, but volume not attached. Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-024e079a-e36c-40e2-bfb6-b030894856c6 tempest-VolumesActionsTest-1935978933 None] Lock "cinder-a69e8238-fde6-4135-808f-7f00887f1b4a-detach_volume" released by "detach_volume" :: held 0.010s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:17 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf" returned: 0 in 0.513s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f4536d3e-9b7c-4dea-bc17-69ac495be1d7,created_at=2026-02-26T19:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-798312693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4536d3e-9b7c-4dea-bc17-69ac495be1d7,host='devstack@QuobyteHD#QuobyteHD',id=4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbdf5b29c61410681c4cc9171e6c411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:17Z,use_quota=True,user_id='c3dd8edc125c40528c7ace847d691988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78e4b1f4-3a02-4078-9df2-1825145dc671),volume_type_id=78e4b1f4-3a02-4078-9df2-1825145dc671)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Creating volume 4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:17 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748f2324-8c88-43c8-868a-d57bd2e520d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321c2b85-446b-475e-9a29-193ad8445edf', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:17 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4 1073741824 Feb 26 20:28:17 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706f0f8d-5b26-44d5-8e17-aed5f140c8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:17 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Volume volume-321c2b85-446b-475e-9a29-193ad8445edf (321c2b85-446b-475e-9a29-193ad8445edf): created successfully Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (706f0f8d-5b26-44d5-8e17-aed5f140c8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Flow 'volume_create_manager' (462fc82d-db2c-40d4-8f51-38f498a030a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:17 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-67083204-516a-4992-9e38-b66197d707a6 tempest-VolumesSnapshotTestJSON-1426572419 None] Created volume successfully. Feb 26 20:28:18 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4 1073741824" returned: 0 in 0.617s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Acquiring lock "cinder-a69e8238-fde6-4135-808f-7f00887f1b4a-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Lock "cinder-a69e8238-fde6-4135-808f-7f00887f1b4a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Acquiring lock "cinder-quobyte-a69e8238-fde6-4135-808f-7f00887f1b4a" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Lock "cinder-quobyte-a69e8238-fde6-4135-808f-7f00887f1b4a" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:18 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4 Feb 26 20:28:18 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b74ace-bad9-45fb-bd39-c9257e63ca47]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a69e8238-fde6-4135-808f-7f00887f1b4a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:18 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a69e8238-fde6-4135-808f-7f00887f1b4a Feb 26 20:28:18 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:18 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4" returned: 0 in 0.500s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.145s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] Creating offline snapshot bc273bde-80d7-435a-95f1-a7ce8dec96f4 of volume 321c2b85-446b-475e-9a29-193ad8445edf {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bfc9c8-e5f6-4779-ad10-fbb71424aa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea27942-d891-41d7-aff1-0b306a4d3e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba96d93-8da4-4f89-a1d4-88a00dab99ee]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:18 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Volume volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4 (4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4): created successfully Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea27942-d891-41d7-aff1-0b306a4d3e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Flow 'volume_create_manager' (4c3867a1-0d82-4095-bf6f-6450d778fd2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:18 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-33ff0d09-39dd-46ee-92cb-6ca618dff191 tempest-GroupsTest-39586389 None] Created volume successfully. Feb 26 20:28:18 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf Feb 26 20:28:18 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:18 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a69e8238-fde6-4135-808f-7f00887f1b4a" returned: 0 in 0.586s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a69e8238-fde6-4135-808f-7f00887f1b4a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:18 devstack sudo[87119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a69e8238-fde6-4135-808f-7f00887f1b4a Feb 26 20:28:18 devstack sudo[87119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:19 devstack sudo[87119]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a69e8238-fde6-4135-808f-7f00887f1b4a" returned: 0 in 0.441s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Lock "cinder-quobyte-a69e8238-fde6-4135-808f-7f00887f1b4a" released by "delete_volume" :: held 1.103s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:19 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf" returned: 0 in 0.622s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:19 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 1G Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Created reservations ['a87cf7b4-2240-48f5-86c0-41b2e4a88557', '1f5cc250-2dad-49bb-a2eb-9979a1850232', '50395657-99d5-4d18-a5f1-81082791ca39', 'debb3371-a590-4807-91f7-6d0530ed1ada'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:19 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:19 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:19 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Flow 'volume_create_manager' (2c6fa445-4cb2-42a5-bb7c-7479de40f1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8b4e03-f0dc-4b90-84d6-86ed791f903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8b4e03-f0dc-4b90-84d6-86ed791f903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-360631626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4536d3e-9b7c-4dea-bc17-69ac495be1d7,host='devstack@QuobyteHD#QuobyteHD',id=77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbdf5b29c61410681c4cc9171e6c411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:20Z,use_quota=True,user_id='c3dd8edc125c40528c7ace847d691988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78e4b1f4-3a02-4078-9df2-1825145dc671),volume_type_id=78e4b1f4-3a02-4078-9df2-1825145dc671)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61950c7b-cb23-4d11-b907-c2f0434fb06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61950c7b-cb23-4d11-b907-c2f0434fb06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ca93d0-8c6b-4696-b581-0840e8d64a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9ca93d0-8c6b-4696-b581-0840e8d64a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5', 'volume_name': 'volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5f0fe1-f4af-4680-87e2-c486ecd57b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5f0fe1-f4af-4680-87e2-c486ecd57b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ceafac-08a9-4fad-8bd0-82828a4a1835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:19 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Volume 77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5', 'volume_size': 1} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:19 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 1G" returned: 0 in 0.565s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321c2b85-446b-475e-9a29-193ad8445edf -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:19 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321c2b85-446b-475e-9a29-193ad8445edf -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 Feb 26 20:28:19 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:19 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.520s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:19 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Deleted volume successfully. Feb 26 20:28:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b346f4a3-efa5-42ab-8e8f-3684a55c61cd tempest-VolumesActionsTest-1935978933 None] Lock "cinder-a69e8238-fde6-4135-808f-7f00887f1b4a-delete_volume" released by "delete_volume" :: held 1.848s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:20 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-321c2b85-446b-475e-9a29-193ad8445edf -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4" returned: 0 in 0.584s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:20 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 is being set with open permissions: ugo+rw Feb 26 20:28:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:20 devstack sudo[87139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 Feb 26 20:28:20 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:21 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4" returned: 0 in 0.565s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:21 devstack sudo[87142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.info Feb 26 20:28:21 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:21 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.info" returned: 0 in 0.523s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:21 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.info is being set with open permissions: ugo+rw Feb 26 20:28:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:21 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.info Feb 26 20:28:21 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:22 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.info" returned: 0 in 0.513s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.464s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.390s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f4536d3e-9b7c-4dea-bc17-69ac495be1d7,created_at=2026-02-26T19:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-360631626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4536d3e-9b7c-4dea-bc17-69ac495be1d7,host='devstack@QuobyteHD#QuobyteHD',id=77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dbdf5b29c61410681c4cc9171e6c411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:20Z,use_quota=True,user_id='c3dd8edc125c40528c7ace847d691988',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78e4b1f4-3a02-4078-9df2-1825145dc671),volume_type_id=78e4b1f4-3a02-4078-9df2-1825145dc671)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Creating volume 77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:22 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:22 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5 1073741824 Feb 26 20:28:22 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:22 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a22d5ec4-687a-46fd-8bf6-20a622d8688e tempest-VolumesSnapshotTestJSON-1426572419 None] Create snapshot completed successfully Feb 26 20:28:22 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5 1073741824" returned: 0 in 0.580s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:22 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5 Feb 26 20:28:22 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-bc273bde-80d7-435a-95f1-a7ce8dec96f4-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-bc273bde-80d7-435a-95f1-a7ce8dec96f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-321c2b85-446b-475e-9a29-193ad8445edf" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-321c2b85-446b-475e-9a29-193ad8445edf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-bc273bde-80d7-435a-95f1-a7ce8dec96f4" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-bc273bde-80d7-435a-95f1-a7ce8dec96f4" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Deleting offline snapshot bc273bde-80d7-435a-95f1-a7ce8dec96f4 of volume 321c2b85-446b-475e-9a29-193ad8445edf {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] snapshot_file for this snap is: volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e32bff-3ad4-40c8-810e-13063aa864ba]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:23 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 Feb 26 20:28:23 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:23 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5" returned: 0 in 0.611s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ceafac-08a9-4fad-8bd0-82828a4a1835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e88db8-260f-4dc8-8da0-913df9b111f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:23 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Volume volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5 (77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5): created successfully Feb 26 20:28:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e88db8-260f-4dc8-8da0-913df9b111f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Flow 'volume_create_manager' (2c6fa445-4cb2-42a5-bb7c-7479de40f1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:23 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0a18be4a-db7c-4414-a13f-f88acbc07b06 tempest-GroupsTest-39586389 None] Created volume successfully. Feb 26 20:28:23 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4" returned: 0 in 0.659s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-321c2b85-446b-475e-9a29-193ad8445edf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:28:23 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[209b7819-256b-42b3-b1a2-0e2bd1ae035f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:23 devstack sudo[87190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf Feb 26 20:28:23 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG oslo_service.periodic_task [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83352) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:24 devstack sudo[87196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:24 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:24 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-5503c3c7-647a-4f28-83eb-d240734bf2ef tempest-GroupsTest-39586389 None] Update group completed successfully. Feb 26 20:28:24 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf" returned: 0 in 0.619s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:24 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 Feb 26 20:28:24 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:24 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.522s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:24 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4" returned: 0 in 0.503s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:24 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4 Feb 26 20:28:24 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:25 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf.bc273bde-80d7-435a-95f1-a7ce8dec96f4" returned: 0 in 0.462s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-bc273bde-80d7-435a-95f1-a7ce8dec96f4" released by "_delete_snapshot" :: held 2.298s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-321c2b85-446b-475e-9a29-193ad8445edf" released by "delete_snapshot" :: held 2.312s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:25 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Created reservations ['618eec59-c879-427e-9474-6eee16ccb33d', '258570a1-5a93-49da-8cf3-4915d063439a', '8764dec0-96fb-4368-bd8a-2a59bc7bcf8e', 'fab97e2a-abd8-4a19-8c84-432703d661a1'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:25 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Delete snapshot completed successfully. Feb 26 20:28:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ad09e62-2b5e-4e7f-ac25-2fac1950b993 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-bc273bde-80d7-435a-95f1-a7ce8dec96f4-delete_snapshot" released by "delete_snapshot" :: held 2.478s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:25 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-6015736c-2632-4d86-a0d5-b9bc64bb539f tempest-GroupsTest-39586389 None] Update group completed successfully. Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Flow 'volume_create_manager' (5b7375af-d2d6-4621-8394-c5f2253cddb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8459899-8a2e-45e9-a76e-2f410b971a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8459899-8a2e-45e9-a76e-2f410b971a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1656597440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db56930-f64c-4c42-88f1-06cf7f705845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7916d91d390f4197b0e0dd42f877a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:26Z,use_quota=True,user_id='e20a23cb162b49a7ba84a23603092e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb95039-f191-4cfb-9e2e-ca0edd005878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb95039-f191-4cfb-9e2e-ca0edd005878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e514a7-ac4d-4a09-acab-6d153543c3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e514a7-ac4d-4a09-acab-6d153543c3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db56930-f64c-4c42-88f1-06cf7f705845', 'volume_name': 'volume-5db56930-f64c-4c42-88f1-06cf7f705845', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c76cb0-c6c9-4b3e-9164-2c4ea292e1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c76cb0-c6c9-4b3e-9164-2c4ea292e1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecd2c89-8f9a-4d72-819d-06a3601df3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:26 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Volume 5db56930-f64c-4c42-88f1-06cf7f705845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db56930-f64c-4c42-88f1-06cf7f705845', 'volume_size': 1} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1656597440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db56930-f64c-4c42-88f1-06cf7f705845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7916d91d390f4197b0e0dd42f877a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:26Z,use_quota=True,user_id='e20a23cb162b49a7ba84a23603092e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Creating volume 5db56930-f64c-4c42-88f1-06cf7f705845 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:26 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:26 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 1073741824 Feb 26 20:28:26 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Acquiring lock "cinder-quobyte-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Lock "cinder-quobyte-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[50abd0be-1758-428e-b92c-9a39a3bc0468]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:27 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4 Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Flow 'volume_create_manager' (ae6f39a7-b886-4caf-ae5b-71445a90fd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:27 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8b4b1e-752c-4195-ba7d-2606309c146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8b4b1e-752c-4195-ba7d-2606309c146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-304806447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbefac68-7a7b-4683-846f-9c90986b4f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572fa6a7af84918b5ba7b46e4cec020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:27Z,use_quota=True,user_id='704736cdb0ae4b1795f6c213bc2c3939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90949855-9145-4e16-9caf-b4ccad2b1137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90949855-9145-4e16-9caf-b4ccad2b1137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbd05d8-dd32-44bd-9a14-b9a452cb53c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbd05d8-dd32-44bd-9a14-b9a452cb53c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbefac68-7a7b-4683-846f-9c90986b4f8e', 'volume_name': 'volume-fbefac68-7a7b-4683-846f-9c90986b4f8e', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ad6218-fd40-4b6a-8d53-f88543ffa17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ad6218-fd40-4b6a-8d53-f88543ffa17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399ac653-cd27-4d66-ac97-d75a7bb89792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:27 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Volume fbefac68-7a7b-4683-846f-9c90986b4f8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbefac68-7a7b-4683-846f-9c90986b4f8e', 'volume_size': 1} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:27 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 1073741824" returned: 0 in 0.762s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:27 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 Feb 26 20:28:27 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:27 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4" returned: 0 in 0.673s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:27 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4 Feb 26 20:28:27 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:27 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845" returned: 0 in 0.498s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-304806447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbefac68-7a7b-4683-846f-9c90986b4f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572fa6a7af84918b5ba7b46e4cec020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:27Z,use_quota=True,user_id='704736cdb0ae4b1795f6c213bc2c3939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Creating volume fbefac68-7a7b-4683-846f-9c90986b4f8e {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:27 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-fbefac68-7a7b-4683-846f-9c90986b4f8e 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecd2c89-8f9a-4d72-819d-06a3601df3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db56930-f64c-4c42-88f1-06cf7f705845', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8758e935-de52-4b3f-98cc-8d72b38e0da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:27 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-fbefac68-7a7b-4683-846f-9c90986b4f8e 1073741824 Feb 26 20:28:27 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:27 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Volume volume-5db56930-f64c-4c42-88f1-06cf7f705845 (5db56930-f64c-4c42-88f1-06cf7f705845): created successfully Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8758e935-de52-4b3f-98cc-8d72b38e0da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Flow 'volume_create_manager' (5b7375af-d2d6-4621-8394-c5f2253cddb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:27 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b9494801-d872-46b1-b481-132c2ca34a11 tempest-VolumesSnapshotTestJSON-1426572419 None] Created volume successfully. Feb 26 20:28:28 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4" returned: 0 in 0.486s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Lock "cinder-quobyte-4c5f85c7-b963-4ae5-aee2-3e9efd0d1cd4" released by "delete_volume" :: held 1.194s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Acquiring lock "cinder-quobyte-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Lock "cinder-quobyte-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b458def2-4aeb-42c7-9c4c-fa89692da9da]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:28 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5 Feb 26 20:28:28 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:28 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-fbefac68-7a7b-4683-846f-9c90986b4f8e 1073741824" returned: 0 in 0.622s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-fbefac68-7a7b-4683-846f-9c90986b4f8e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:28 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-fbefac68-7a7b-4683-846f-9c90986b4f8e Feb 26 20:28:28 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:28 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5" returned: 0 in 0.590s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:28 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5 Feb 26 20:28:28 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:28 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-fbefac68-7a7b-4683-846f-9c90986b4f8e" returned: 0 in 0.443s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.177s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] Creating offline snapshot 55b00e55-289f-4fe4-961a-c82c19e3c207 of volume 5db56930-f64c-4c42-88f1-06cf7f705845 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399ac653-cd27-4d66-ac97-d75a7bb89792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbefac68-7a7b-4683-846f-9c90986b4f8e', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9eafd3-6a05-4b33-ba46-98f2f0135574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cb0d9f-aca0-40c1-8908-75f322006d13]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:28 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Volume volume-fbefac68-7a7b-4683-846f-9c90986b4f8e (fbefac68-7a7b-4683-846f-9c90986b4f8e): created successfully Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9eafd3-6a05-4b33-ba46-98f2f0135574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Flow 'volume_create_manager' (ae6f39a7-b886-4caf-ae5b-71445a90fd35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:28 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b23c170b-c825-498a-bb6e-7c0bbeb18e41 tempest-VolumesActionsTest-1935978933 None] Created volume successfully. Feb 26 20:28:28 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 Feb 26 20:28:28 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:29 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5" returned: 0 in 0.536s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Lock "cinder-quobyte-77d3d89d-0620-4804-b4f9-7f4b5e7fe4f5" released by "delete_volume" :: held 1.153s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Created reservations ['3c1210a0-7e25-4910-bf9a-2b131e48506a'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:29 devstack cinder-volume[83352]: WARNING cinder.quota [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-489168430 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-489168430, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:28:29 devstack cinder-volume[83352]: WARNING cinder.quota [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-489168430 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-489168430, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Acquiring lock "cinder-fbefac68-7a7b-4683-846f-9c90986b4f8e-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Created reservations ['590e475b-53e3-4a54-a9b9-601899a6a84a', '7b77c804-84c0-4c5d-adce-57a5e2b1603a', '8b8c26af-5467-4c3d-ba8a-d1952094254f', '52909398-abf2-42d2-a195-e3052d839aac'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Lock "cinder-fbefac68-7a7b-4683-846f-9c90986b4f8e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Acquiring lock "cinder-quobyte-fbefac68-7a7b-4683-846f-9c90986b4f8e" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Lock "cinder-quobyte-fbefac68-7a7b-4683-846f-9c90986b4f8e" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[935b96ce-2d89-4f44-b466-ecf87fd0a29f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-fbefac68-7a7b-4683-846f-9c90986b4f8e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Created reservations ['63a76744-7dd1-4b07-99a8-87e5f893e816', 'ec35e697-36a2-4267-8631-c7c81167da95', '55a00030-09e3-4cb1-a723-352a33761f76', 'aa71ebf8-3cee-4bfc-83c4-146802ca15d3'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:29 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845" returned: 0 in 0.695s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:29 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 1G Feb 26 20:28:29 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:29 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-fbefac68-7a7b-4683-846f-9c90986b4f8e Feb 26 20:28:29 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:29 devstack sudo[87249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:29 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:30 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 1G" returned: 0 in 0.573s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db56930-f64c-4c42-88f1-06cf7f705845 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:30 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-fbefac68-7a7b-4683-846f-9c90986b4f8e" returned: 0 in 0.682s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-fbefac68-7a7b-4683-846f-9c90986b4f8e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:30 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db56930-f64c-4c42-88f1-06cf7f705845 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 Feb 26 20:28:30 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:30 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.551s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:30 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-ee32b655-019c-4587-90bc-fc4bbe414774 tempest-GroupsTest-39586389 None] Delete group completed successfully. Feb 26 20:28:30 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-fbefac68-7a7b-4683-846f-9c90986b4f8e Feb 26 20:28:30 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:30 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5db56930-f64c-4c42-88f1-06cf7f705845 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207" returned: 0 in 0.536s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:30 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 is being set with open permissions: ugo+rw Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:30 devstack sudo[87266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 Feb 26 20:28:30 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-fbefac68-7a7b-4683-846f-9c90986b4f8e" returned: 0 in 0.539s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:30 devstack sudo[87266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Lock "cinder-quobyte-fbefac68-7a7b-4683-846f-9c90986b4f8e" released by "delete_volume" :: held 1.246s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Created reservations ['7b384512-d6e5-4965-8166-cd04c481beef', '9bfa9a7f-3cc6-428b-8380-38aefaaef965', 'fddc43e5-3e0f-4121-8466-c54cbfea026b', 'f1bde53a-daef-4a80-8d89-eb725f2d3f96'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:30 devstack sudo[87268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:30 devstack sudo[87268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:31 devstack sudo[87266]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207" returned: 0 in 0.522s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:31 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.info Feb 26 20:28:31 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:31 devstack sudo[87268]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.573s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:31 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:31 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Deleted volume successfully. Feb 26 20:28:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9ab412b1-cc63-4842-b304-6a10346f6f97 tempest-VolumesActionsTest-707709635 None] Lock "cinder-fbefac68-7a7b-4683-846f-9c90986b4f8e-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:31 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.info" returned: 0 in 0.668s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:31 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.info is being set with open permissions: ugo+rw Feb 26 20:28:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:31 devstack sudo[87275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.info Feb 26 20:28:31 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:31 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Flow 'volume_create_manager' (d5cee2c6-65bf-47c9-b025-4d6c99918453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d67e43-493f-4d5d-a929-e3e6749b73cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85d67e43-493f-4d5d-a929-e3e6749b73cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-227704535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5368d9af-d8b0-476d-ba18-dddb897c2f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572fa6a7af84918b5ba7b46e4cec020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:32Z,use_quota=True,user_id='704736cdb0ae4b1795f6c213bc2c3939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca39876-db0d-491a-a64c-36aed752db6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca39876-db0d-491a-a64c-36aed752db6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da2c55a-32e3-4456-b346-b57f7f35ee5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da2c55a-32e3-4456-b346-b57f7f35ee5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5368d9af-d8b0-476d-ba18-dddb897c2f2e', 'volume_name': 'volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b053987e-5b16-4cd9-9ac9-2347cca11028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b053987e-5b16-4cd9-9ac9-2347cca11028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4d94d8-09c4-47fe-af0e-fdbfa0eb5366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:32 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Volume 5368d9af-d8b0-476d-ba18-dddb897c2f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e', 'volume_size': 1} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:32 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.info" returned: 0 in 0.516s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.582s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.366s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-227704535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5368d9af-d8b0-476d-ba18-dddb897c2f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572fa6a7af84918b5ba7b46e4cec020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:32Z,use_quota=True,user_id='704736cdb0ae4b1795f6c213bc2c3939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Creating volume 5368d9af-d8b0-476d-ba18-dddb897c2f2e {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:32 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:32 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7b0ee673-9578-4610-88ff-dac67b8c67cc tempest-VolumesSnapshotTestJSON-1426572419 None] Create snapshot completed successfully Feb 26 20:28:32 devstack sudo[87278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e 1073741824 Feb 26 20:28:32 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:33 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Flow 'volume_create_manager' (e9fbf7ac-fbe2-44a8-b993-e4a377a4c779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa64800-68f1-4188-a1c3-0ed20b2928ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e 1073741824" returned: 0 in 0.922s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa64800-68f1-4188-a1c3-0ed20b2928ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1967991332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b77a68-bf34-4799-a143-60275e8bdcae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7916d91d390f4197b0e0dd42f877a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=55b00e55-289f-4fe4-961a-c82c19e3c207,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:33Z,use_quota=True,user_id='e20a23cb162b49a7ba84a23603092e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620a7542-5771-4868-bb2a-7848d1a657e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (620a7542-5771-4868-bb2a-7848d1a657e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f78d1c-3ec0-4a46-a71b-f2c5614c48d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f78d1c-3ec0-4a46-a71b-f2c5614c48d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '27b77a68-bf34-4799-a143-60275e8bdcae', 'volume_name': 'volume-27b77a68-bf34-4799-a143-60275e8bdcae', 'volume_size': 2, 'snapshot_id': '55b00e55-289f-4fe4-961a-c82c19e3c207'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dd58ba-bf12-4173-bd79-3119fdbb0782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02dd58ba-bf12-4173-bd79-3119fdbb0782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf39d99-72bd-4f42-890b-a0ac502d9ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:33 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Volume 27b77a68-bf34-4799-a143-60275e8bdcae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-27b77a68-bf34-4799-a143-60275e8bdcae', 'volume_size': 2, 'snapshot_id': '55b00e55-289f-4fe4-961a-c82c19e3c207'} Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:33 devstack sudo[87283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e Feb 26 20:28:33 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:33 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e" returned: 0 in 0.569s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.577s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-55b00e55-289f-4fe4-961a-c82c19e3c207-27b77a68-bf34-4799-a143-60275e8bdcae" by "_create_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-55b00e55-289f-4fe4-961a-c82c19e3c207-27b77a68-bf34-4799-a143-60275e8bdcae" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Creating volume 27b77a68-bf34-4799-a143-60275e8bdcae from snapshot 55b00e55-289f-4fe4-961a-c82c19e3c207 {{(pid=83352) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-27b77a68-bf34-4799-a143-60275e8bdcae" by "_copy_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4d94d8-09c4-47fe-af0e-fdbfa0eb5366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f925621d-8df1-4175-95b4-6320929d57bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:34 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Volume volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e (5368d9af-d8b0-476d-ba18-dddb897c2f2e): created successfully Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f925621d-8df1-4175-95b4-6320929d57bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Flow 'volume_create_manager' (d5cee2c6-65bf-47c9-b025-4d6c99918453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-27b77a68-bf34-4799-a143-60275e8bdcae" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] snapshot: 55b00e55-289f-4fe4-961a-c82c19e3c207, volume: 27b77a68-bf34-4799-a143-60275e8bdcae, {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:34 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f9026c73-933e-42b8-bde9-dd853e2e6aa9 tempest-VolumesActionsTest-1935978933 None] Created volume successfully. Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eef7288-6397-4cb3-aae6-bbb540eecb74]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:34 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 Feb 26 20:28:34 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:34 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207" returned: 0 in 0.641s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5db56930-f64c-4c42-88f1-06cf7f705845(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Creating direct copy from snapshot {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[466e2886-4d8a-4f12-9d62-5fcef04427e3]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:34 devstack sudo[87291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 Feb 26 20:28:34 devstack sudo[87291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:35 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Acquiring lock "cinder-5368d9af-d8b0-476d-ba18-dddb897c2f2e-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:35 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Lock "cinder-5368d9af-d8b0-476d-ba18-dddb897c2f2e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:35 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Acquiring lock "cinder-quobyte-5368d9af-d8b0-476d-ba18-dddb897c2f2e" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:35 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Lock "cinder-quobyte-5368d9af-d8b0-476d-ba18-dddb897c2f2e" acquired by "delete_volume" :: waited 0.007s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:35 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3ddf3e-d338-47a8-a1e2-9420a27089aa]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:35 devstack sudo[87291]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845" returned: 0 in 0.752s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:35 devstack cinder-volume[83352]: DEBUG cinder.utils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Path /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae not found in is_blk_device check {{(pid=83352) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 20:28:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:35 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae Feb 26 20:28:35 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e Feb 26 20:28:35 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:35 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:36 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e" returned: 0 in 0.965s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:36 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e Feb 26 20:28:36 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:38 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5368d9af-d8b0-476d-ba18-dddb897c2f2e" returned: 0 in 1.827s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Lock "cinder-quobyte-5368d9af-d8b0-476d-ba18-dddb897c2f2e" released by "delete_volume" :: held 2.853s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:38 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae" returned: 0 in 2.809s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:38 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3b1ca4-63bd-408f-8413-4ac7e81970a7]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:38 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Created reservations ['4aa6ad41-61fb-4923-9759-c150481c2dff', '7c5732fa-00cc-4812-8189-37cd782e0850', '5bec6ed5-1e9e-4bd5-98cc-20dad89eb006', 'e88fd670-5be4-47ea-9819-e60fad5ccb27'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:38 devstack sudo[87324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 Feb 26 20:28:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:38 devstack sudo[87324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:38 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:38 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:39 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.527s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:39 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Deleted volume successfully. Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d4d7fe6e-349e-4c11-ae20-99f76f5c36bb tempest-VolumesActionsTest-707709635 None] Lock "cinder-5368d9af-d8b0-476d-ba18-dddb897c2f2e-delete_volume" released by "delete_volume" :: held 3.656s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:39 devstack sudo[87324]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845" returned: 0 in 0.796s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845, size 1024.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:28:39 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Converted 1024.00 MB image at 364.43 MB/s Feb 26 20:28:39 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae is being set with open permissions: ugo+rw Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:39 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae Feb 26 20:28:39 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Flow 'volume_create_manager' (8f765c24-4c77-4469-83a6-d0594d6e198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc11573-b655-4620-861a-7892b8fa3a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bc11573-b655-4620-861a-7892b8fa3a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1149071331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ed133d-73f6-4e7b-ac7d-985564e406b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572fa6a7af84918b5ba7b46e4cec020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:39Z,use_quota=True,user_id='704736cdb0ae4b1795f6c213bc2c3939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e12f9b-6825-4b0f-a2e9-c5f4e22bf0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e12f9b-6825-4b0f-a2e9-c5f4e22bf0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ddad3d-2de5-4dd5-a432-185d370b809b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ddad3d-2de5-4dd5-a432-185d370b809b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5ed133d-73f6-4e7b-ac7d-985564e406b2', 'volume_name': 'volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea765d0-8fad-431c-be9f-3e99b67660be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea765d0-8fad-431c-be9f-3e99b67660be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4102f5e1-449d-41ac-a829-f2e4793c1551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:39 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Volume a5ed133d-73f6-4e7b-ac7d-985564e406b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2', 'volume_size': 1} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:39 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae" returned: 0 in 0.471s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-27b77a68-bf34-4799-a143-60275e8bdcae" released by "_copy_volume_from_snapshot" :: held 5.567s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-55b00e55-289f-4fe4-961a-c82c19e3c207-27b77a68-bf34-4799-a143-60275e8bdcae" released by "_create_volume_from_snapshot" :: held 5.617s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.637s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.380s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1149071331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ed133d-73f6-4e7b-ac7d-985564e406b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572fa6a7af84918b5ba7b46e4cec020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:39Z,use_quota=True,user_id='704736cdb0ae4b1795f6c213bc2c3939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Creating volume a5ed133d-73f6-4e7b-ac7d-985564e406b2 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:39 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:39 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2 1073741824 Feb 26 20:28:39 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf39d99-72bd-4f42-890b-a0ac502d9ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b77a68-bf34-4799-a143-60275e8bdcae', 'volume_size': 2, 'snapshot_id': '55b00e55-289f-4fe4-961a-c82c19e3c207'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d892f1e-ce3c-46d9-8328-4d7b10627ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:39 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Volume volume-27b77a68-bf34-4799-a143-60275e8bdcae (27b77a68-bf34-4799-a143-60275e8bdcae): created successfully Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d892f1e-ce3c-46d9-8328-4d7b10627ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Flow 'volume_create_manager' (e9fbf7ac-fbe2-44a8-b993-e4a377a4c779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:39 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1117af63-3671-4a3c-be45-bc5d3862dc43 tempest-VolumesSnapshotTestJSON-1426572419 None] Created volume successfully. Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-27b77a68-bf34-4799-a143-60275e8bdcae-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-27b77a68-bf34-4799-a143-60275e8bdcae-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-27b77a68-bf34-4799-a143-60275e8bdcae" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-27b77a68-bf34-4799-a143-60275e8bdcae" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6bdbba-c74e-4474-8657-5298eadf3409]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:40 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae Feb 26 20:28:40 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:40 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2 1073741824" returned: 0 in 0.706s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:40 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2 Feb 26 20:28:40 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:40 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae" returned: 0 in 0.780s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:40 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae Feb 26 20:28:40 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:40 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2" returned: 0 in 0.543s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4102f5e1-449d-41ac-a829-f2e4793c1551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed7b8de-3743-4bdc-ac9c-17344dbbd36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:40 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Volume volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2 (a5ed133d-73f6-4e7b-ac7d-985564e406b2): created successfully Feb 26 20:28:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bed7b8de-3743-4bdc-ac9c-17344dbbd36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Flow 'volume_create_manager' (8f765c24-4c77-4469-83a6-d0594d6e198a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:40 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-42e0ca8e-cada-4719-a227-2af156569817 tempest-VolumesActionsTest-1935978933 None] Created volume successfully. Feb 26 20:28:41 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27b77a68-bf34-4799-a143-60275e8bdcae" returned: 0 in 0.648s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-27b77a68-bf34-4799-a143-60275e8bdcae" released by "delete_volume" :: held 1.454s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Created reservations ['98da1bea-f76e-4888-8836-b409389ca4de', 'bc4519af-9996-41ea-b246-02846059bb9c', '7a0e305c-da01-4b30-bbe9-1fc35c5ebe10', 'edef002a-3873-4f40-9256-d96f66140fd2'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Acquiring lock "cinder-a5ed133d-73f6-4e7b-ac7d-985564e406b2-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Lock "cinder-a5ed133d-73f6-4e7b-ac7d-985564e406b2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Acquiring lock "cinder-quobyte-a5ed133d-73f6-4e7b-ac7d-985564e406b2" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:41 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:41 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Lock "cinder-quobyte-a5ed133d-73f6-4e7b-ac7d-985564e406b2" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[783134eb-72e1-419d-bf33-c9b7882bc802]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:41 devstack sudo[87360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2 Feb 26 20:28:41 devstack sudo[87360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:42 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.662s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:42 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Deleted volume successfully. Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25e83d80-c10c-4cc8-a5ff-56d646bb4b22 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-27b77a68-bf34-4799-a143-60275e8bdcae-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:42 devstack sudo[87360]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2" returned: 0 in 0.651s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-55b00e55-289f-4fe4-961a-c82c19e3c207-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-55b00e55-289f-4fe4-961a-c82c19e3c207-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-5db56930-f64c-4c42-88f1-06cf7f705845" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:42 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2 Feb 26 20:28:42 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-5db56930-f64c-4c42-88f1-06cf7f705845" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-55b00e55-289f-4fe4-961a-c82c19e3c207" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-55b00e55-289f-4fe4-961a-c82c19e3c207" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Deleting offline snapshot 55b00e55-289f-4fe4-961a-c82c19e3c207 of volume 5db56930-f64c-4c42-88f1-06cf7f705845 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] snapshot_file for this snap is: volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[5687f2dd-f10d-4284-bb3f-d64a5b1d544f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:42 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 Feb 26 20:28:42 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:42 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5ed133d-73f6-4e7b-ac7d-985564e406b2" returned: 0 in 0.700s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Lock "cinder-quobyte-a5ed133d-73f6-4e7b-ac7d-985564e406b2" released by "delete_volume" :: held 1.382s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Created reservations ['dbdd01c7-4ba0-49e5-9d8c-675abe073cad', '6bd309e2-86c3-43d4-ad0a-d67b9a1dd471', 'ad6f9d8a-4dac-45b8-96da-2fff5c0e016c', '3adbff4f-c401-4926-af7e-0d7714eeee85'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:43 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:43 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:43 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207" returned: 0 in 0.828s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5db56930-f64c-4c42-88f1-06cf7f705845(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3afe89-908b-4c50-ad16-07d3ce94162b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:43 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 Feb 26 20:28:43 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:43 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.622s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:43 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Deleted volume successfully. Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=162,cinder:UPDATE=190,cinder:DELETE=11,cinder:INSERT=38 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:28:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1968da26-a432-42a7-9fe4-67eeda10285c tempest-VolumesActionsTest-707709635 None] Lock "cinder-a5ed133d-73f6-4e7b-ac7d-985564e406b2-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:44 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845" returned: 0 in 0.757s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:44 devstack sudo[87399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 Feb 26 20:28:44 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=159,cinder:UPDATE=169,cinder:INSERT=43,cinder:DELETE=13 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Flow 'volume_create_manager' (12859ea4-3b2a-4b7e-9450-ca7364e141c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee7ba67-d6a7-419f-8bbc-4557d1ffb04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee7ba67-d6a7-419f-8bbc-4557d1ffb04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-845790324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7473971-cfbf-40d0-8e6f-0d12a0aeceab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572fa6a7af84918b5ba7b46e4cec020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:44Z,use_quota=True,user_id='704736cdb0ae4b1795f6c213bc2c3939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ef6e13-4603-42be-9428-110558ccaed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ef6e13-4603-42be-9428-110558ccaed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4846ed85-d732-4d55-9aab-ec192ef5dc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4846ed85-d732-4d55-9aab-ec192ef5dc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7473971-cfbf-40d0-8e6f-0d12a0aeceab', 'volume_name': 'volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5939509c-5070-4127-9694-18ecd43314d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5939509c-5070-4127-9694-18ecd43314d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc837296-aeac-4d0e-a091-1f5a7ba555f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:44 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Volume a7473971-cfbf-40d0-8e6f-0d12a0aeceab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab', 'volume_size': 1} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-845790324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7473971-cfbf-40d0-8e6f-0d12a0aeceab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572fa6a7af84918b5ba7b46e4cec020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:44Z,use_quota=True,user_id='704736cdb0ae4b1795f6c213bc2c3939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Creating volume a7473971-cfbf-40d0-8e6f-0d12a0aeceab {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:44 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:44 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab 1073741824 Feb 26 20:28:44 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:44 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207" returned: 0 in 0.678s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:44 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207 Feb 26 20:28:44 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:45 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab 1073741824" returned: 0 in 0.707s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:45 devstack sudo[87426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab Feb 26 20:28:45 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:45 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845.55b00e55-289f-4fe4-961a-c82c19e3c207" returned: 0 in 0.653s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-55b00e55-289f-4fe4-961a-c82c19e3c207" released by "_delete_snapshot" :: held 3.012s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-5db56930-f64c-4c42-88f1-06cf7f705845" released by "delete_snapshot" :: held 3.026s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Created reservations ['f10bbe4e-0e4b-42a7-8dfc-b79e55636c9b', 'a6a3ba56-4f9d-47aa-8225-2aead7f78b0c', 'd51bde1e-4ad5-43da-916f-283d567f355b', '485970a3-f731-475b-8dfe-6333f924da91'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:45 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Delete snapshot completed successfully. Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1dcaf118-d0e7-449b-b1a8-4084065f83b1 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-55b00e55-289f-4fe4-961a-c82c19e3c207-delete_snapshot" released by "delete_snapshot" :: held 3.180s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:45 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab" returned: 0 in 0.519s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc837296-aeac-4d0e-a091-1f5a7ba555f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ef0b05-4c12-4ef2-aa08-97ff27f4f1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:45 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Volume volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab (a7473971-cfbf-40d0-8e6f-0d12a0aeceab): created successfully Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ef0b05-4c12-4ef2-aa08-97ff27f4f1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Flow 'volume_create_manager' (12859ea4-3b2a-4b7e-9450-ca7364e141c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:45 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e6ff1eeb-91f9-45e9-8e32-d2ee7bc0a4b6 tempest-VolumesActionsTest-1935978933 None] Created volume successfully. Feb 26 20:28:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Acquiring lock "cinder-a7473971-cfbf-40d0-8e6f-0d12a0aeceab-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Lock "cinder-a7473971-cfbf-40d0-8e6f-0d12a0aeceab-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-5db56930-f64c-4c42-88f1-06cf7f705845-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Acquiring lock "cinder-quobyte-a7473971-cfbf-40d0-8e6f-0d12a0aeceab" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-5db56930-f64c-4c42-88f1-06cf7f705845-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Lock "cinder-quobyte-a7473971-cfbf-40d0-8e6f-0d12a0aeceab" acquired by "delete_volume" :: waited 0.018s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:46 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0924929f-cde1-4cb1-9ba2-d4a64b39198e]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-5db56930-f64c-4c42-88f1-06cf7f705845" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-5db56930-f64c-4c42-88f1-06cf7f705845" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:46 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95ee0a0-a43a-4682-9ad6-980679b690e9]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:46 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab Feb 26 20:28:46 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:46 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 Feb 26 20:28:46 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:47 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab" returned: 0 in 0.929s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:47 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab Feb 26 20:28:47 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:47 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845" returned: 0 in 0.978s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:47 devstack sudo[87508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845 Feb 26 20:28:47 devstack sudo[87508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:48 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a7473971-cfbf-40d0-8e6f-0d12a0aeceab" returned: 0 in 0.696s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:48 devstack sudo[87508]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Lock "cinder-quobyte-a7473971-cfbf-40d0-8e6f-0d12a0aeceab" released by "delete_volume" :: held 1.660s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5db56930-f64c-4c42-88f1-06cf7f705845" returned: 0 in 0.614s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-5db56930-f64c-4c42-88f1-06cf7f705845" released by "delete_volume" :: held 1.626s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Created reservations ['e98c5c52-b312-48d1-9c38-16dc798c4d9b', '52ff7be6-7f85-425b-8869-d6672de86129', '4a87b2d5-c39c-4ad2-a24a-587a362c669c', 'a3107f45-c3eb-4262-9c23-545c7624778f'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Created reservations ['f16aace3-32c4-4c69-bd3f-6b807d39faf1', 'af580182-812f-4ba2-aa7b-ea7a8318f46c', '22c55f6a-7f7c-4341-80ef-d890e68e7478', 'ed46222c-a94c-49ce-958e-3fe8db112fe6'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:48 devstack sudo[87513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:48 devstack sudo[87513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Flow 'volume_create_manager' (c6e04884-0ad6-449b-8314-130eda11e084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa784f63-caa3-4a89-8424-e847a7231940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa784f63-caa3-4a89-8424-e847a7231940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2005252564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fb59fe-92d8-4d2c-a12d-a08730788b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e2ccdd1814ba2bbb66c5c27f7ee66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:48Z,use_quota=True,user_id='61cbc02e1d34478997200d600219829c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5560014c-ab95-403f-9dcb-5093cb9b15dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5560014c-ab95-403f-9dcb-5093cb9b15dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123cfb90-d385-43ce-9366-ed8d693560a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (123cfb90-d385-43ce-9366-ed8d693560a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59fb59fe-92d8-4d2c-a12d-a08730788b87', 'volume_name': 'volume-59fb59fe-92d8-4d2c-a12d-a08730788b87', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a34187-e4eb-4063-8596-50d03a792b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a34187-e4eb-4063-8596-50d03a792b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badfb934-239b-4e4d-b592-11c9e967926c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:48 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Volume 59fb59fe-92d8-4d2c-a12d-a08730788b87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59fb59fe-92d8-4d2c-a12d-a08730788b87', 'volume_size': 1} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2005252564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fb59fe-92d8-4d2c-a12d-a08730788b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e2ccdd1814ba2bbb66c5c27f7ee66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:48Z,use_quota=True,user_id='61cbc02e1d34478997200d600219829c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Creating volume 59fb59fe-92d8-4d2c-a12d-a08730788b87 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:48 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:48 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 1073741824 Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:48 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:48 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:48 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:49 devstack sudo[87513]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.639s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:49 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Deleted volume successfully. Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-58fa23bf-267c-45a5-a7a5-ff9d62740ef9 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-5db56930-f64c-4c42-88f1-06cf7f705845-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Flow 'volume_create_manager' (88e9f4fb-88b9-46ec-a0b0-73f44bae312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84639d45-b973-4368-8cd7-94803f532014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84639d45-b973-4368-8cd7-94803f532014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-282979404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd4baee-fed5-4c88-b6b4-942cc3ecf07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7916d91d390f4197b0e0dd42f877a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:50Z,use_quota=True,user_id='e20a23cb162b49a7ba84a23603092e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a689e35-1192-4aed-8d00-076a327a4d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a689e35-1192-4aed-8d00-076a327a4d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794a0f10-dffb-4901-b1e5-ea988d193ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794a0f10-dffb-4901-b1e5-ea988d193ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abd4baee-fed5-4c88-b6b4-942cc3ecf07f', 'volume_name': 'volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0a48b9-552c-454c-9e95-0321e3486516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0a48b9-552c-454c-9e95-0321e3486516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0707742-1744-44c5-9cc9-f06cfa77c675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:49 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Volume abd4baee-fed5-4c88-b6b4-942cc3ecf07f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f', 'volume_size': 1} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Flow 'volume_create_manager' (3130034a-9056-4907-b7f2-3bc7b043cee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b918c310-7b44-4533-96da-4907e0bb4d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b918c310-7b44-4533-96da-4907e0bb4d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1125463253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a659e44-70ce-48e4-97c7-5b25bb097cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572fa6a7af84918b5ba7b46e4cec020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:50Z,use_quota=True,user_id='704736cdb0ae4b1795f6c213bc2c3939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8390241-32a4-4dd0-801e-4bc498e7108b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8390241-32a4-4dd0-801e-4bc498e7108b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087a7133-8306-4e73-9c0f-f800016cb0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087a7133-8306-4e73-9c0f-f800016cb0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a659e44-70ce-48e4-97c7-5b25bb097cd7', 'volume_name': 'volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4283b4fb-e3fc-4526-a18b-5194a5b34784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4283b4fb-e3fc-4526-a18b-5194a5b34784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f8e0a3-7d6d-4c73-b09a-b5238d47ed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:49 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Volume 5a659e44-70ce-48e4-97c7-5b25bb097cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7', 'volume_size': 1} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:49 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 1.298s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:49 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Deleted volume successfully. Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7e5c8cf1-2666-4688-813b-c828cf9e809a tempest-VolumesActionsTest-707709635 None] Lock "cinder-a7473971-cfbf-40d0-8e6f-0d12a0aeceab-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:49 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 1073741824" returned: 0 in 1.401s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:50 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 Feb 26 20:28:50 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:50 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87" returned: 0 in 0.509s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.795s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-282979404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd4baee-fed5-4c88-b6b4-942cc3ecf07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7916d91d390f4197b0e0dd42f877a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:50Z,use_quota=True,user_id='e20a23cb162b49a7ba84a23603092e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Creating volume abd4baee-fed5-4c88-b6b4-942cc3ecf07f {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:50 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badfb934-239b-4e4d-b592-11c9e967926c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59fb59fe-92d8-4d2c-a12d-a08730788b87', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b32f81f-d8b4-43c3-8aa9-50a2b69892ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:50 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f 1073741824 Feb 26 20:28:50 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:50 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Volume volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 (59fb59fe-92d8-4d2c-a12d-a08730788b87): created successfully Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b32f81f-d8b4-43c3-8aa9-50a2b69892ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Flow 'volume_create_manager' (c6e04884-0ad6-449b-8314-130eda11e084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:50 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a8d9bfd1-0a4b-4d1a-967d-8b95360c4a32 tempest-VolumesDeleteCascade-1293554344 None] Created volume successfully. Feb 26 20:28:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:51 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f 1073741824" returned: 0 in 0.720s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:51 devstack sudo[87559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f Feb 26 20:28:51 devstack sudo[87559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:51 devstack sudo[87559]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" returned: 0 in 0.610s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.039s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1125463253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a659e44-70ce-48e4-97c7-5b25bb097cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1572fa6a7af84918b5ba7b46e4cec020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:28:50Z,use_quota=True,user_id='704736cdb0ae4b1795f6c213bc2c3939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Creating volume 5a659e44-70ce-48e4-97c7-5b25bb097cd7 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:28:51 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0707742-1744-44c5-9cc9-f06cfa77c675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83324015-91fa-46af-8ded-e4a9997c6943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:51 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7 1073741824 Feb 26 20:28:51 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:51 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Volume volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f (abd4baee-fed5-4c88-b6b4-942cc3ecf07f): created successfully Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83324015-91fa-46af-8ded-e4a9997c6943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Flow 'volume_create_manager' (88e9f4fb-88b9-46ec-a0b0-73f44bae312b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:51 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-2f0e8c91-7113-40f2-b423-d6bfc0d67d2c tempest-VolumesSnapshotTestJSON-1426572419 None] Created volume successfully. Feb 26 20:28:52 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7 1073741824" returned: 0 in 0.609s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:52 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7 Feb 26 20:28:52 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:53 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7" returned: 0 in 0.499s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.150s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f8e0a3-7d6d-4c73-b09a-b5238d47ed55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958f4bae-cae3-428b-b0ba-1ee47dbfb334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] Creating offline snapshot 9c735910-de8b-440f-abf6-a6e2796dc486 of volume 59fb59fe-92d8-4d2c-a12d-a08730788b87 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:28:53 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Volume volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7 (5a659e44-70ce-48e4-97c7-5b25bb097cd7): created successfully Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958f4bae-cae3-428b-b0ba-1ee47dbfb334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Flow 'volume_create_manager' (3130034a-9056-4907-b7f2-3bc7b043cee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:28:53 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a64b8e77-9a48-4ccd-a12b-4211dac9018d tempest-VolumesActionsTest-1935978933 None] Created volume successfully. Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6c657e-578d-4621-95c9-cf590a594124]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:53 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 Feb 26 20:28:53 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:53 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87" returned: 0 in 0.569s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:53 devstack sudo[87575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 1G Feb 26 20:28:53 devstack sudo[87575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:54 devstack sudo[87575]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 1G" returned: 0 in 0.650s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:54 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 Feb 26 20:28:54 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "cinder-5a659e44-70ce-48e4-97c7-5b25bb097cd7-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Lock "cinder-5a659e44-70ce-48e4-97c7-5b25bb097cd7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "cinder-quobyte-5a659e44-70ce-48e4-97c7-5b25bb097cd7" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:28:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Lock "cinder-quobyte-5a659e44-70ce-48e4-97c7-5b25bb097cd7" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:28:54 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[945a3256-553c-4a6b-8afa-428c270102b9]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:54 devstack sudo[87582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7 Feb 26 20:28:54 devstack sudo[87582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:54 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486" returned: 0 in 0.574s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:54 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 is being set with open permissions: ugo+rw Feb 26 20:28:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:55 devstack sudo[87587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 Feb 26 20:28:55 devstack sudo[87587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:55 devstack sudo[87582]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7" returned: 0 in 0.618s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:55 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7 Feb 26 20:28:55 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:55 devstack sudo[87587]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486" returned: 0 in 0.513s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:55 devstack sudo[87601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.info Feb 26 20:28:55 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:55 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a659e44-70ce-48e4-97c7-5b25bb097cd7" returned: 0 in 0.653s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Lock "cinder-quobyte-5a659e44-70ce-48e4-97c7-5b25bb097cd7" released by "delete_volume" :: held 1.298s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Created reservations ['80e6b2c6-a0f5-4404-b298-f8dc41a372bd', '9ad0339d-380b-44bc-b691-ec4f183ee00d', '8701be01-5f91-41e0-9d12-477dac620007', '988ef642-2c50-450a-bfed-f9ff54226e20'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:56 devstack sudo[87623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:28:56 devstack sudo[87623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:56 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.info" returned: 0 in 0.828s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:56 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.info is being set with open permissions: ugo+rw Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:56 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.info Feb 26 20:28:56 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:56 devstack sudo[87623]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.516s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:28:56 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Deleted volume successfully. Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-42640493-01c0-4134-b2db-7f863a482cd3 tempest-VolumesActionsTest-1935978933 None] Lock "cinder-5a659e44-70ce-48e4-97c7-5b25bb097cd7-delete_volume" released by "delete_volume" :: held 2.001s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:28:56 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.info" returned: 0 in 0.443s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.784s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.865s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] Creating offline snapshot c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 of volume abd4baee-fed5-4c88-b6b4-942cc3ecf07f {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fb3da7-645b-40d7-9528-5ed5cfbbfbd5]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:28:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:56 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1ca82d84-3220-4610-93b8-76d9106ae7f7 tempest-VolumesDeleteCascade-1293554344 None] Create snapshot completed successfully Feb 26 20:28:56 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f Feb 26 20:28:56 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:28:57 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" returned: 0 in 0.716s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:57 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 1G Feb 26 20:28:57 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:58 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 1G" returned: 0 in 0.653s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:58 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 Feb 26 20:28:58 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:58 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593" returned: 0 in 0.540s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:58 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 is being set with open permissions: ugo+rw Feb 26 20:28:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:58 devstack sudo[87655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 Feb 26 20:28:58 devstack sudo[87655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:59 devstack sudo[87655]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593" returned: 0 in 0.517s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:59 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.info Feb 26 20:28:59 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:28:59 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Feb 26 20:28:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.info" returned: 0 in 0.606s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:28:59 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.info is being set with open permissions: ugo+rw Feb 26 20:28:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:28:59 devstack sudo[87665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.info Feb 26 20:28:59 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:00 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.info" returned: 0 in 0.460s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.596s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.134s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] Creating offline snapshot 63ba76a9-bb8c-4d05-872b-81dc3a3bc26f of volume 59fb59fe-92d8-4d2c-a12d-a08730788b87 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:29:00 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-eac1343c-ed02-4607-9c95-373e8bd73241 tempest-VolumesSnapshotTestJSON-1426572419 None] Create snapshot completed successfully Feb 26 20:29:00 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f68d1e-8fa5-49d0-9e43-8be4161783d7]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:00 devstack sudo[87668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 Feb 26 20:29:00 devstack sudo[87668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:01 devstack sudo[87668]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486" returned: 0 in 0.786s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fb59fe-92d8-4d2c-a12d-a08730788b87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:01 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f 1G Feb 26 20:29:01 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Flow 'volume_create_manager' (96e96e0d-f4d1-46ed-ba8a-e94d6379081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e438d5cd-fe71-4deb-bcab-9683748f9507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e438d5cd-fe71-4deb-bcab-9683748f9507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1831427621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab14061f-04f3-450b-8764-58129b759801,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7916d91d390f4197b0e0dd42f877a2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c6e9f5dd-fd68-4543-8a9e-93a9b72e0593,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:02Z,use_quota=True,user_id='e20a23cb162b49a7ba84a23603092e56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9ec32d-5c95-4d44-bbe7-3229da010116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9ec32d-5c95-4d44-bbe7-3229da010116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccfc343-8f1b-43d1-9a92-ce49d38940bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ccfc343-8f1b-43d1-9a92-ce49d38940bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ab14061f-04f3-450b-8764-58129b759801', 'volume_name': 'volume-ab14061f-04f3-450b-8764-58129b759801', 'volume_size': 1, 'snapshot_id': 'c6e9f5dd-fd68-4543-8a9e-93a9b72e0593'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6a9c31-a757-4939-8b44-dbad8f543373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b6a9c31-a757-4939-8b44-dbad8f543373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8957cf35-beee-4dc7-ab2d-2a5713d06343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:02 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Volume ab14061f-04f3-450b-8764-58129b759801: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ab14061f-04f3-450b-8764-58129b759801', 'volume_size': 1, 'snapshot_id': 'c6e9f5dd-fd68-4543-8a9e-93a9b72e0593'} Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:02 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f 1G" returned: 0 in 1.300s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:02 devstack sudo[87708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f Feb 26 20:29:02 devstack sudo[87708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Flow 'volume_create_manager' (f27dc397-3eb6-4a35-93e2-5ce2264fdb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44997d0e-daab-44a1-aa2b-522ca507211b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44997d0e-daab-44a1-aa2b-522ca507211b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2059279131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0112db-7402-4fb1-b379-11487838ac6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a05cec7e71740528836af6970d50783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:03Z,use_quota=True,user_id='64c4ffa2bd6c4761810671fd6650a92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:03 devstack sudo[87708]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7bde09-eaf7-417e-a918-1cccd2fea8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef7bde09-eaf7-417e-a918-1cccd2fea8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024fac03-e5e1-471d-b4b5-d2c1b6f5e349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024fac03-e5e1-471d-b4b5-d2c1b6f5e349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a0112db-7402-4fb1-b379-11487838ac6f', 'volume_name': 'volume-9a0112db-7402-4fb1-b379-11487838ac6f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c40250-69f2-4fd3-aff6-bc0f56ca7c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c40250-69f2-4fd3-aff6-bc0f56ca7c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe777bd-6df0-4d9a-8173-df07bdf658c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:03 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Volume 9a0112db-7402-4fb1-b379-11487838ac6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a0112db-7402-4fb1-b379-11487838ac6f', 'volume_size': 1} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f" returned: 0 in 0.892s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:03 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f is being set with open permissions: ugo+rw Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:03 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f Feb 26 20:29:03 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:03 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f" returned: 0 in 0.465s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.543s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.668s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-c6e9f5dd-fd68-4543-8a9e-93a9b72e0593-ab14061f-04f3-450b-8764-58129b759801" by "_create_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-c6e9f5dd-fd68-4543-8a9e-93a9b72e0593-ab14061f-04f3-450b-8764-58129b759801" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Creating volume ab14061f-04f3-450b-8764-58129b759801 from snapshot c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 {{(pid=83352) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-ab14061f-04f3-450b-8764-58129b759801" by "_copy_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:04 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0fbbf94b-5c0b-4553-8094-7da83d325db2 tempest-VolumesDeleteCascade-1293554344 None] Create snapshot completed successfully Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-ab14061f-04f3-450b-8764-58129b759801" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] snapshot: c6e9f5dd-fd68-4543-8a9e-93a9b72e0593, volume: ab14061f-04f3-450b-8764-58129b759801, {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c2e837-1be0-4a33-a008-9fefd182fac3]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:04 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 Feb 26 20:29:04 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-59fb59fe-92d8-4d2c-a12d-a08730788b87-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-59fb59fe-92d8-4d2c-a12d-a08730788b87-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Performing cascade delete. {{(pid=83352) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-63ba76a9-bb8c-4d05-872b-81dc3a3bc26f-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-63ba76a9-bb8c-4d05-872b-81dc3a3bc26f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-quobyte-59fb59fe-92d8-4d2c-a12d-a08730788b87" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-59fb59fe-92d8-4d2c-a12d-a08730788b87" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-quobyte-63ba76a9-bb8c-4d05-872b-81dc3a3bc26f" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-63ba76a9-bb8c-4d05-872b-81dc3a3bc26f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Deleting offline snapshot 63ba76a9-bb8c-4d05-872b-81dc3a3bc26f of volume 59fb59fe-92d8-4d2c-a12d-a08730788b87 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:29:04 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] snapshot_file for this snap is: volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593" returned: 0 in 0.692s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Creating direct copy from snapshot {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a54c8a1-31c5-4727-b4b0-6355e476413d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[1140abfc-7bce-4db1-bacf-27c5cb12ea32]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:04 devstack sudo[87725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f Feb 26 20:29:04 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:05 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f Feb 26 20:29:05 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:05 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" returned: 0 in 0.730s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:05 devstack cinder-volume[83352]: DEBUG cinder.utils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Path /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801 not found in is_blk_device check {{(pid=83352) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 20:29:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:05 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801 Feb 26 20:29:05 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:05 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f" returned: 0 in 0.800s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:05 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fb59fe-92d8-4d2c-a12d-a08730788b87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:05 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f760ef2-ca32-453a-8952-9e07c71ae1d0]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:05 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 Feb 26 20:29:05 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:07 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486" returned: 0 in 1.939s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fb59fe-92d8-4d2c-a12d-a08730788b87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:07 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f Feb 26 20:29:07 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:09 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801" returned: 0 in 3.703s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:09 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb37be5f-493f-43f5-a385-5bb8e47c8879]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:09 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f Feb 26 20:29:09 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:09 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f" returned: 0 in 1.906s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:09 devstack sudo[87761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f Feb 26 20:29:09 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:10 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:10 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" returned: 0 in 1.024s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f, size 1024.00 MB, duration 3.70 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801 {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:29:10 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Converted 1024.00 MB image at 276.44 MB/s Feb 26 20:29:10 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801 is being set with open permissions: ugo+rw Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.63ba76a9-bb8c-4d05-872b-81dc3a3bc26f" returned: 0 in 0.802s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:10 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801 Feb 26 20:29:10 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-63ba76a9-bb8c-4d05-872b-81dc3a3bc26f" released by "_delete_snapshot" :: held 5.570s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-59fb59fe-92d8-4d2c-a12d-a08730788b87" released by "delete_snapshot" :: held 5.588s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Created reservations ['366f055d-953a-41ee-a97c-dd992d057259', '4be75618-2faf-4a94-8989-2004d66dd488', '59d84224-51ed-4575-8a74-2e003bb57fb7', '0a3add41-1b46-4337-9b2a-d41f8cbdd2c1'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:10 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Delete snapshot completed successfully. Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-63ba76a9-bb8c-4d05-872b-81dc3a3bc26f-delete_snapshot" released by "delete_snapshot" :: held 5.843s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-9c735910-de8b-440f-abf6-a6e2796dc486-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-9c735910-de8b-440f-abf6-a6e2796dc486-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-quobyte-59fb59fe-92d8-4d2c-a12d-a08730788b87" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-59fb59fe-92d8-4d2c-a12d-a08730788b87" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-quobyte-9c735910-de8b-440f-abf6-a6e2796dc486" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-9c735910-de8b-440f-abf6-a6e2796dc486" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Deleting offline snapshot 9c735910-de8b-440f-abf6-a6e2796dc486 of volume 59fb59fe-92d8-4d2c-a12d-a08730788b87 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] snapshot_file for this snap is: volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2135ea-6d17-432e-aa38-9a7a96582b74]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:10 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 Feb 26 20:29:10 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:11 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801" returned: 0 in 0.717s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-ab14061f-04f3-450b-8764-58129b759801" released by "_copy_volume_from_snapshot" :: held 6.970s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-c6e9f5dd-fd68-4543-8a9e-93a9b72e0593-ab14061f-04f3-450b-8764-58129b759801" released by "_create_volume_from_snapshot" :: held 7.015s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.072s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.573s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2059279131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a0112db-7402-4fb1-b379-11487838ac6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a05cec7e71740528836af6970d50783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:03Z,use_quota=True,user_id='64c4ffa2bd6c4761810671fd6650a92e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Creating volume 9a0112db-7402-4fb1-b379-11487838ac6f {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:29:11 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9a0112db-7402-4fb1-b379-11487838ac6f 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:11 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9a0112db-7402-4fb1-b379-11487838ac6f 1073741824 Feb 26 20:29:11 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8957cf35-beee-4dc7-ab2d-2a5713d06343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab14061f-04f3-450b-8764-58129b759801', 'volume_size': 1, 'snapshot_id': 'c6e9f5dd-fd68-4543-8a9e-93a9b72e0593'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a236cc33-c474-4b00-b1ae-9a146f76faff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:11 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Volume volume-ab14061f-04f3-450b-8764-58129b759801 (ab14061f-04f3-450b-8764-58129b759801): created successfully Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a236cc33-c474-4b00-b1ae-9a146f76faff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Flow 'volume_create_manager' (96e96e0d-f4d1-46ed-ba8a-e94d6379081e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:11 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e863573e-199f-43b8-aa70-8db177e232af tempest-VolumesSnapshotTestJSON-1426572419 None] Created volume successfully. Feb 26 20:29:11 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486" returned: 0 in 0.963s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59fb59fe-92d8-4d2c-a12d-a08730788b87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[61351c97-0f89-4e31-99de-9ed817b7bc97]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:11 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 Feb 26 20:29:11 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:12 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9a0112db-7402-4fb1-b379-11487838ac6f 1073741824" returned: 0 in 0.963s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9a0112db-7402-4fb1-b379-11487838ac6f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:12 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9a0112db-7402-4fb1-b379-11487838ac6f Feb 26 20:29:12 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:12 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-ab14061f-04f3-450b-8764-58129b759801-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:12 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-ab14061f-04f3-450b-8764-58129b759801-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:12 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87" returned: 0 in 1.059s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:12 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 Feb 26 20:29:12 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:12 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-ab14061f-04f3-450b-8764-58129b759801" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:12 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-ab14061f-04f3-450b-8764-58129b759801" acquired by "delete_volume" :: waited 0.024s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:12 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0f7c24-3d80-47d6-b840-dfcda9b4078b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:12 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9a0112db-7402-4fb1-b379-11487838ac6f" returned: 0 in 0.913s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:29:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:13 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801 Feb 26 20:29:13 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe777bd-6df0-4d9a-8173-df07bdf658c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a0112db-7402-4fb1-b379-11487838ac6f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6591550b-88a4-41c4-af65-c1eef4d893e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:13 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Volume volume-9a0112db-7402-4fb1-b379-11487838ac6f (9a0112db-7402-4fb1-b379-11487838ac6f): created successfully Feb 26 20:29:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6591550b-88a4-41c4-af65-c1eef4d893e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Flow 'volume_create_manager' (f27dc397-3eb6-4a35-93e2-5ce2264fdb1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:13 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-9eb70000-88d4-4d61-a0ae-9502e1589763 tempest-ServerRescueNegativeTestJSON-856742167 None] Created volume successfully. Feb 26 20:29:13 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801" returned: 0 in 1.096s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:13 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801 Feb 26 20:29:13 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:13 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486" returned: 0 in 1.276s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:14 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486 Feb 26 20:29:14 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:14 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ab14061f-04f3-450b-8764-58129b759801" returned: 0 in 0.779s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:14 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-ab14061f-04f3-450b-8764-58129b759801" released by "delete_volume" :: held 1.913s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87.9c735910-de8b-440f-abf6-a6e2796dc486" returned: 0 in 0.726s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-9c735910-de8b-440f-abf6-a6e2796dc486" released by "_delete_snapshot" :: held 4.119s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-59fb59fe-92d8-4d2c-a12d-a08730788b87" released by "delete_snapshot" :: held 4.143s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Created reservations ['fc277a83-6ac4-45a6-9297-d9b8e71ad252', 'd1f367b7-f648-4e45-88ad-f907b88e86ae', '3999aa62-7ebf-4dcf-b286-e79c72788e0a', '37226b97-7178-4598-b775-4afe8b80966a'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:14 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:14 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:14 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Created reservations ['7a17f27f-f476-46b9-81ae-23f032b07ba6', '0af8ad75-b596-499f-8e01-3813d71965ca', '18e39936-b450-4f6b-8643-3ac6aa82b6ce', '21370813-33d8-4023-8851-9fe4995d16fd'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:15 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Delete snapshot completed successfully. Feb 26 20:29:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-9c735910-de8b-440f-abf6-a6e2796dc486-delete_snapshot" released by "delete_snapshot" :: held 4.444s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Snapshots deleted, issuing volume delete {{(pid=83352) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 26 20:29:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-quobyte-59fb59fe-92d8-4d2c-a12d-a08730788b87" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-59fb59fe-92d8-4d2c-a12d-a08730788b87" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:15 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d56b04b-ae2d-4ae4-8260-bb7d2cab9940]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:15 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 Feb 26 20:29:15 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:16 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 1.222s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:16 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Deleted volume successfully. Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c333b1f1-38f0-4204-9aee-5e478124adaa tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-ab14061f-04f3-450b-8764-58129b759801-delete_volume" released by "delete_volume" :: held 3.532s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:16 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87" returned: 0 in 1.113s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:16 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87 Feb 26 20:29:16 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Flow 'volume_create_manager' (fd1771ba-2401-47ab-bc26-c40c364a30a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d04c51-7e9a-40b2-b2d8-9a68bd080791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d04c51-7e9a-40b2-b2d8-9a68bd080791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-919245897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429b2401-b08c-43d7-9313-b9a2f074dde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='691421798bb5447ca445850a5f528ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:16Z,use_quota=True,user_id='6122ecd313434da4851ef76511ef028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83c2589-e613-4d02-a383-2af201cda408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a83c2589-e613-4d02-a383-2af201cda408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23dcf723-287f-4e93-830d-d9aa00f96d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23dcf723-287f-4e93-830d-d9aa00f96d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429b2401-b08c-43d7-9313-b9a2f074dde7', 'volume_name': 'volume-429b2401-b08c-43d7-9313-b9a2f074dde7', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e28058-7dd4-44ae-ade8-8264478bbe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e28058-7dd4-44ae-ade8-8264478bbe90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d1c9f9-3c3e-414f-ac0e-652913fe7da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:16 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Volume 429b2401-b08c-43d7-9313-b9a2f074dde7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429b2401-b08c-43d7-9313-b9a2f074dde7', 'volume_size': 1} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-919245897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429b2401-b08c-43d7-9313-b9a2f074dde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='691421798bb5447ca445850a5f528ef7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:16Z,use_quota=True,user_id='6122ecd313434da4851ef76511ef028c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Creating volume 429b2401-b08c-43d7-9313-b9a2f074dde7 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:29:16 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:16 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 1073741824 Feb 26 20:29:16 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-c6e9f5dd-fd68-4543-8a9e-93a9b72e0593-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-c6e9f5dd-fd68-4543-8a9e-93a9b72e0593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-c6e9f5dd-fd68-4543-8a9e-93a9b72e0593" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-c6e9f5dd-fd68-4543-8a9e-93a9b72e0593" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Deleting offline snapshot c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 of volume abd4baee-fed5-4c88-b6b4-942cc3ecf07f {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] snapshot_file for this snap is: volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a97935-ec7a-4171-a110-8a6b1cf12677]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:16 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-59fb59fe-92d8-4d2c-a12d-a08730788b87" returned: 0 in 0.683s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:16 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 Feb 26 20:29:16 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-59fb59fe-92d8-4d2c-a12d-a08730788b87" released by "delete_volume" :: held 1.932s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Created reservations ['66c64750-11a3-4c6c-a149-5d72b1e96d97', 'e221f4cb-8125-402f-a347-a211bbbb37fa', '5505ec72-37cc-4f11-9ecc-31e13409670e', 'f92700b8-cc87-4ead-ad36-378562a8672f'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:17 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:17 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:17 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 1073741824" returned: 0 in 1.076s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:17 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593" returned: 0 in 0.832s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:17 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 Feb 26 20:29:17 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:17 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.515s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:17 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Deleted volume successfully. Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05a36c8-88eb-45e3-8b8f-b12b557d1cb3]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e75e13dd-e8c9-4e55-901f-2e8e8ac45045 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-59fb59fe-92d8-4d2c-a12d-a08730788b87-delete_volume" released by "delete_volume" :: held 13.065s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:17 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f Feb 26 20:29:17 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:18 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7" returned: 0 in 0.731s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d1c9f9-3c3e-414f-ac0e-652913fe7da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429b2401-b08c-43d7-9313-b9a2f074dde7', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7627bc22-74f8-4ca1-a279-a336b7d0ed78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:18 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Volume volume-429b2401-b08c-43d7-9313-b9a2f074dde7 (429b2401-b08c-43d7-9313-b9a2f074dde7): created successfully Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7627bc22-74f8-4ca1-a279-a336b7d0ed78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Flow 'volume_create_manager' (fd1771ba-2401-47ab-bc26-c40c364a30a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:18 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0ed173d2-2841-49db-8989-c7a8717ee27d tempest-SnapshotMetadataTestJSON-1158393250 None] Created volume successfully. Feb 26 20:29:18 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" returned: 0 in 0.852s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:18 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 Feb 26 20:29:18 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Flow 'volume_create_manager' (3dc5ebaf-a7e2-4079-b92f-3bc4f69260c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a11976-27f7-4abb-88fe-4e5750a79796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a11976-27f7-4abb-88fe-4e5750a79796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1845196029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17359a46-3122-426c-8c8b-37cf5c045bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e2ccdd1814ba2bbb66c5c27f7ee66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:19Z,use_quota=True,user_id='61cbc02e1d34478997200d600219829c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d25ca1-c2b1-42b8-830d-654a51840066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d25ca1-c2b1-42b8-830d-654a51840066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee60f3e-7ade-4cab-b541-d39d8997512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eee60f3e-7ade-4cab-b541-d39d8997512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17359a46-3122-426c-8c8b-37cf5c045bfd', 'volume_name': 'volume-17359a46-3122-426c-8c8b-37cf5c045bfd', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf860aa0-5e0f-4d00-a3c4-79acf65a3e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf860aa0-5e0f-4d00-a3c4-79acf65a3e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fd8881-c7ff-46f5-8e7f-e7296fce8173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:18 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Volume 17359a46-3122-426c-8c8b-37cf5c045bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17359a46-3122-426c-8c8b-37cf5c045bfd', 'volume_size': 1} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1845196029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17359a46-3122-426c-8c8b-37cf5c045bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e2ccdd1814ba2bbb66c5c27f7ee66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:19Z,use_quota=True,user_id='61cbc02e1d34478997200d600219829c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Creating volume 17359a46-3122-426c-8c8b-37cf5c045bfd {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:29:18 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:29:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:18 devstack sudo[87882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd 1073741824 Feb 26 20:29:18 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:19 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593" returned: 0 in 0.506s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:19 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593 Feb 26 20:29:19 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:19 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd 1073741824" returned: 0 in 0.592s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:19 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd Feb 26 20:29:19 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:19 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f.c6e9f5dd-fd68-4543-8a9e-93a9b72e0593" returned: 0 in 0.618s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-c6e9f5dd-fd68-4543-8a9e-93a9b72e0593" released by "_delete_snapshot" :: held 3.003s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" released by "delete_snapshot" :: held 3.031s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:19 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Created reservations ['1f1070ec-42c8-421f-a774-8ba47e43194b', '56002ea2-71bd-4105-9cb6-8c2a3607736f', '26c5d3b5-676b-4711-ace1-b4e2806eb583', '4c6cd732-c052-4245-9eb9-c8aa95298efb'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:19 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Delete snapshot completed successfully. Feb 26 20:29:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a038b299-487e-4d22-877b-109b6b301a72 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-c6e9f5dd-fd68-4543-8a9e-93a9b72e0593-delete_snapshot" released by "delete_snapshot" :: held 3.163s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:20 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd" returned: 0 in 0.539s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.426s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fd8881-c7ff-46f5-8e7f-e7296fce8173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17359a46-3122-426c-8c8b-37cf5c045bfd', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d72ab31-f9a2-45a1-9450-635cf75046b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] Creating offline snapshot 936974f4-8b2a-4ee5-8ee7-5ce0618ade6a of volume 429b2401-b08c-43d7-9313-b9a2f074dde7 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:29:20 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Volume volume-17359a46-3122-426c-8c8b-37cf5c045bfd (17359a46-3122-426c-8c8b-37cf5c045bfd): created successfully Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d72ab31-f9a2-45a1-9450-635cf75046b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Flow 'volume_create_manager' (3dc5ebaf-a7e2-4079-b92f-3bc4f69260c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d43387e-d8b1-4d2c-9bc2-340852e00a2d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:20 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-80ae575c-6051-4888-b34b-c43cd09e0c96 tempest-VolumesDeleteCascade-1293554344 None] Created volume successfully. Feb 26 20:29:20 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 Feb 26 20:29:20 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:20 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7" returned: 0 in 0.548s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:20 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a 1G Feb 26 20:29:20 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:20 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-abd4baee-fed5-4c88-b6b4-942cc3ecf07f-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-abd4baee-fed5-4c88-b6b4-942cc3ecf07f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:21 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[210ce21e-f3e3-4e01-a324-0815f4a88f68]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:21 devstack sudo[87910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f Feb 26 20:29:21 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:21 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a 1G" returned: 0 in 0.662s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429b2401-b08c-43d7-9313-b9a2f074dde7 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:21 devstack sudo[87915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429b2401-b08c-43d7-9313-b9a2f074dde7 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a Feb 26 20:29:21 devstack sudo[87915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:21 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" returned: 0 in 0.597s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:21 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f Feb 26 20:29:21 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:21 devstack sudo[87915]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429b2401-b08c-43d7-9313-b9a2f074dde7 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a" returned: 0 in 0.485s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:21 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a is being set with open permissions: ugo+rw Feb 26 20:29:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:21 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a Feb 26 20:29:21 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:22 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" returned: 0 in 0.479s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-abd4baee-fed5-4c88-b6b4-942cc3ecf07f" released by "delete_volume" :: held 1.113s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Created reservations ['45a0a2f3-b6fd-47cb-b4e8-10b19e342a13', '6f975fce-7757-4c83-ac19-a5b206fbd8bb', '8f70080e-56f8-493c-8bc1-51bc867462a5', '03f3e93b-5966-4c3b-9279-ca72fa607a75'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:22 devstack sudo[87929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:22 devstack sudo[87929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:22 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a" returned: 0 in 0.529s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:22 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.info Feb 26 20:29:22 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:22 devstack sudo[87929]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.642s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:22 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Deleted volume successfully. Feb 26 20:29:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c2434875-8faa-4987-9b20-18bfec12c480 tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-abd4baee-fed5-4c88-b6b4-942cc3ecf07f-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:23 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.info" returned: 0 in 0.804s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:23 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.info is being set with open permissions: ugo+rw Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:23 devstack sudo[87964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.info Feb 26 20:29:23 devstack sudo[87964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-321c2b85-446b-475e-9a29-193ad8445edf-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-321c2b85-446b-475e-9a29-193ad8445edf-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "cinder-quobyte-321c2b85-446b-475e-9a29-193ad8445edf" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-321c2b85-446b-475e-9a29-193ad8445edf" acquired by "delete_volume" :: waited 0.007s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[5307e253-5ddb-4511-8384-802fe54d126f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:23 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf Feb 26 20:29:23 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:23 devstack sudo[87964]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.info" returned: 0 in 0.651s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.783s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.675s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] Creating offline snapshot 203e6927-994f-45b4-bbd2-327f0e11964f of volume 17359a46-3122-426c-8c8b-37cf5c045bfd {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:29:23 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-4c231a38-4a59-4f87-ba90-cc9e5af37a7d tempest-SnapshotMetadataTestJSON-1158393250 None] Create snapshot completed successfully Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[86205423-3b1b-4b9e-8d4e-635e29c9fb5f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:24 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd Feb 26 20:29:24 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:24 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf" returned: 0 in 0.732s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:24 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf Feb 26 20:29:24 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG oslo_service.periodic_task [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83352) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:24 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:24 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:24 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd" returned: 0 in 0.729s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:24 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f 1G Feb 26 20:29:24 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:24 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.713s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:24 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-321c2b85-446b-475e-9a29-193ad8445edf" returned: 0 in 0.854s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-quobyte-321c2b85-446b-475e-9a29-193ad8445edf" released by "delete_volume" :: held 1.661s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:25 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Created reservations ['36511408-66fd-46c5-965e-f522be9d4304', '564f8d59-e014-4624-9718-21290bfb47cd', '4426ab34-7b06-4104-8758-4a95af8a0dfa', '1fe7bfab-df9f-4202-a219-727654020fec'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:25 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:25 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:25 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f 1G" returned: 0 in 0.984s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17359a46-3122-426c-8c8b-37cf5c045bfd -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:25 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17359a46-3122-426c-8c8b-37cf5c045bfd -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f Feb 26 20:29:25 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Acquiring lock "cinder-936974f4-8b2a-4ee5-8ee7-5ce0618ade6a-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "cinder-936974f4-8b2a-4ee5-8ee7-5ce0618ade6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Acquiring lock "cinder-quobyte-429b2401-b08c-43d7-9313-b9a2f074dde7" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "cinder-quobyte-429b2401-b08c-43d7-9313-b9a2f074dde7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Acquiring lock "cinder-quobyte-936974f4-8b2a-4ee5-8ee7-5ce0618ade6a" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "cinder-quobyte-936974f4-8b2a-4ee5-8ee7-5ce0618ade6a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Deleting offline snapshot 936974f4-8b2a-4ee5-8ee7-5ce0618ade6a of volume 429b2401-b08c-43d7-9313-b9a2f074dde7 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] snapshot_file for this snap is: volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:29:26 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.907s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:26 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Deleted volume successfully. Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1cc0d5-adb3-4b51-a50b-bd6343e77e86]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d5771252-4772-4574-86d3-53e0644feccc tempest-VolumesSnapshotTestJSON-1426572419 None] Lock "cinder-321c2b85-446b-475e-9a29-193ad8445edf-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:26 devstack sudo[87994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a Feb 26 20:29:26 devstack sudo[87994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:26 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17359a46-3122-426c-8c8b-37cf5c045bfd -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f" returned: 0 in 0.857s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:26 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f is being set with open permissions: ugo+rw Feb 26 20:29:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:26 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f Feb 26 20:29:26 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:27 devstack sudo[87994]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a" returned: 0 in 0.933s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-429b2401-b08c-43d7-9313-b9a2f074dde7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:27 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8f4b56-3f69-4540-8574-1ea992ed4104]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:27 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 Feb 26 20:29:27 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:27 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f" returned: 0 in 0.735s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:27 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.info Feb 26 20:29:27 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:27 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7" returned: 0 in 0.739s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:27 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a Feb 26 20:29:27 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:28 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.info" returned: 0 in 0.783s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:28 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.info is being set with open permissions: ugo+rw Feb 26 20:29:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:28 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.info Feb 26 20:29:28 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:28 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a" returned: 0 in 1.055s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:28 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a Feb 26 20:29:28 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:29 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.info" returned: 0 in 1.052s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.260s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:29 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c06a3fbe-db1f-4e93-9dcc-c01f9463538d tempest-VolumesDeleteCascade-1293554344 None] Create snapshot completed successfully Feb 26 20:29:29 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7.936974f4-8b2a-4ee5-8ee7-5ce0618ade6a" returned: 0 in 0.768s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "cinder-quobyte-936974f4-8b2a-4ee5-8ee7-5ce0618ade6a" released by "_delete_snapshot" :: held 3.707s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "cinder-quobyte-429b2401-b08c-43d7-9313-b9a2f074dde7" released by "delete_snapshot" :: held 3.723s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:29 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Created reservations ['93ca0da0-33c9-4968-b6c5-ede2e96110c4', '6ccd296f-5d84-487b-8363-72076ff7b9e9', '1d0a794f-98c2-420c-a2b7-6fbe7c765bb5', '93c0bceb-5868-4ba4-8fba-42966abd69b1'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:29 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Delete snapshot completed successfully. Feb 26 20:29:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1b9c6e24-06fb-4d9e-bee1-41505c411bcb tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "cinder-936974f4-8b2a-4ee5-8ee7-5ce0618ade6a-delete_snapshot" released by "delete_snapshot" :: held 3.918s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Flow 'volume_create_manager' (3ec56905-fb29-49ec-9a8f-31db0165c7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d412eec1-8636-439b-bd2f-33a17fec640e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Acquiring lock "cinder-429b2401-b08c-43d7-9313-b9a2f074dde7-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Acquiring lock "cinder-9a0112db-7402-4fb1-b379-11487838ac6f-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d412eec1-8636-439b-bd2f-33a17fec640e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-235539829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063c9a96-b800-40c4-a43c-6fce184ca436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='522e2ccdd1814ba2bbb66c5c27f7ee66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=203e6927-994f-45b4-bbd2-327f0e11964f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:30Z,use_quota=True,user_id='61cbc02e1d34478997200d600219829c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3263d36-774a-4d6d-9f46-859f94445e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3263d36-774a-4d6d-9f46-859f94445e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d82319-6d49-4037-9d68-fa98030f88e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d82319-6d49-4037-9d68-fa98030f88e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '063c9a96-b800-40c4-a43c-6fce184ca436', 'volume_name': 'volume-063c9a96-b800-40c4-a43c-6fce184ca436', 'volume_size': 1, 'snapshot_id': '203e6927-994f-45b4-bbd2-327f0e11964f'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29cd33e-40e1-4cb3-af6c-4d3600114123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29cd33e-40e1-4cb3-af6c-4d3600114123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c536179-5061-45b7-9d81-497c42fc7bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:30 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Volume 063c9a96-b800-40c4-a43c-6fce184ca436: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-063c9a96-b800-40c4-a43c-6fce184ca436', 'volume_size': 1, 'snapshot_id': '203e6927-994f-45b4-bbd2-327f0e11964f'} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "cinder-429b2401-b08c-43d7-9313-b9a2f074dde7-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Lock "cinder-9a0112db-7402-4fb1-b379-11487838ac6f-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-quobyte-203e6927-994f-45b4-bbd2-327f0e11964f-063c9a96-b800-40c4-a43c-6fce184ca436" by "_create_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-203e6927-994f-45b4-bbd2-327f0e11964f-063c9a96-b800-40c4-a43c-6fce184ca436" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Creating volume 063c9a96-b800-40c4-a43c-6fce184ca436 from snapshot 203e6927-994f-45b4-bbd2-327f0e11964f {{(pid=83352) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-quobyte-063c9a96-b800-40c4-a43c-6fce184ca436" by "_copy_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Acquiring lock "cinder-quobyte-429b2401-b08c-43d7-9313-b9a2f074dde7" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Acquiring lock "cinder-quobyte-9a0112db-7402-4fb1-b379-11487838ac6f" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-063c9a96-b800-40c4-a43c-6fce184ca436" acquired by "_copy_volume_from_snapshot" :: waited 0.063s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] snapshot: 203e6927-994f-45b4-bbd2-327f0e11964f, volume: 063c9a96-b800-40c4-a43c-6fce184ca436, {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Lock "cinder-quobyte-9a0112db-7402-4fb1-b379-11487838ac6f" acquired by "delete_volume" :: waited 0.110s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "cinder-quobyte-429b2401-b08c-43d7-9313-b9a2f074dde7" acquired by "delete_volume" :: waited 0.128s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce66230f-7fe8-4f21-bd7e-5a30893e4173]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b899d07-a89e-42d8-9c9a-09ef73c6887c]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9a0112db-7402-4fb1-b379-11487838ac6f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddde8674-14eb-4189-9eb1-2354d1c02f6f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:30 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9a0112db-7402-4fb1-b379-11487838ac6f Feb 26 20:29:30 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:31 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f Feb 26 20:29:31 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:31 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 Feb 26 20:29:31 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:31 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f" returned: 0 in 1.142s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17359a46-3122-426c-8c8b-37cf5c045bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 20:29:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Creating direct copy from snapshot {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 20:29:31 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0deef7-1cc2-4d18-954b-d054713154da]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:31 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9a0112db-7402-4fb1-b379-11487838ac6f" returned: 0 in 1.158s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9a0112db-7402-4fb1-b379-11487838ac6f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:32 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9a0112db-7402-4fb1-b379-11487838ac6f Feb 26 20:29:32 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:32 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd Feb 26 20:29:32 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:32 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7" returned: 0 in 1.307s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:32 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7 Feb 26 20:29:32 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:32 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9a0112db-7402-4fb1-b379-11487838ac6f" returned: 0 in 0.961s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Lock "cinder-quobyte-9a0112db-7402-4fb1-b379-11487838ac6f" released by "delete_volume" :: held 2.196s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Created reservations ['e277b3b7-8a54-4295-9959-23ce07b1341e', '7390f087-fc60-4414-958a-6d36df1f79ce', '02c3e4e7-cec6-4901-8b37-3f99d7dbfb1d', '126aa65c-1ac8-44b7-b875-19e6eab61d92'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:33 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:33 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-429b2401-b08c-43d7-9313-b9a2f074dde7" returned: 0 in 0.919s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd" returned: 0 in 1.118s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG cinder.utils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Path /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436 not found in is_blk_device check {{(pid=83352) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:33 devstack sudo[88133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:33 devstack sudo[88133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "cinder-quobyte-429b2401-b08c-43d7-9313-b9a2f074dde7" released by "delete_volume" :: held 2.372s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:33 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436 Feb 26 20:29:33 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Created reservations ['df26d0bd-cc80-4a2e-a631-f41297cbc9a9', 'c1e983d5-463a-47b4-9956-8c186e1a98de', '27582a43-96e6-40b6-b03f-f3b7fdf97e05', '20c5e8a4-41d3-4fa6-b2b6-7ee7fbd48706'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:33 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:33 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:33 devstack sudo[88133]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.810s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:33 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Deleted volume successfully. Feb 26 20:29:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3333728f-d043-468c-8bec-2794c6eb2922 tempest-ServerRescueNegativeTestJSON-856742167 None] Lock "cinder-9a0112db-7402-4fb1-b379-11487838ac6f-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:34 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 1.162s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:34 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:34 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Deleted volume successfully. Feb 26 20:29:34 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:29:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Flow 'volume_create_manager' (c567e60e-503c-42d0-a837-a87fcde9b725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b036021-9c54-4949-ba58-6b136425cf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b036021-9c54-4949-ba58-6b136425cf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1570609622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02df045b-357e-41ce-a926-2cc9bb08cec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f6afc9630240a8a5c89061e72322ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:34Z,use_quota=True,user_id='9ace90628b7f4c0cabf22e53deadb9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7286a882-df58-4866-aeac-3761d64f1ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7286a882-df58-4866-aeac-3761d64f1ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfaf5b5e-3b4d-450f-8756-48cc39d2077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfaf5b5e-3b4d-450f-8756-48cc39d2077b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02df045b-357e-41ce-a926-2cc9bb08cec3', 'volume_name': 'volume-02df045b-357e-41ce-a926-2cc9bb08cec3', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b403ab-352a-4e6a-b924-d45ab54e7a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b403ab-352a-4e6a-b924-d45ab54e7a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9fd506-9bca-4d95-b900-b5a45e395790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:35 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Volume 02df045b-357e-41ce-a926-2cc9bb08cec3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02df045b-357e-41ce-a926-2cc9bb08cec3', 'volume_size': 1} Feb 26 20:29:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:35 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3c9ac87e-29be-45c0-92a3-1d58a982b0d3 tempest-SnapshotMetadataTestJSON-1158393250 None] Lock "cinder-429b2401-b08c-43d7-9313-b9a2f074dde7-delete_volume" released by "delete_volume" :: held 4.682s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:36 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436" returned: 0 in 3.820s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:36 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a7a17f-f227-4f54-9846-87a7137effed]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:37 devstack sudo[88178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd Feb 26 20:29:37 devstack sudo[88178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:38 devstack sudo[88178]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd" returned: 0 in 1.107s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd, size 1024.00 MB, duration 3.82 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436 {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:29:38 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Converted 1024.00 MB image at 267.98 MB/s Feb 26 20:29:38 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436 is being set with open permissions: ugo+rw Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:38 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436 Feb 26 20:29:38 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:29:38 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Flow 'volume_create_manager' (33938f46-b888-4ec2-b707-2f6cde17e6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec14ae9-3dd6-4a55-87c8-c4ba3b9f8bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436" returned: 0 in 0.547s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec14ae9-3dd6-4a55-87c8-c4ba3b9f8bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-489997546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b2ebd6-5025-4711-96d2-330633e6982a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0a86d3e4ef4977957a7609dc16e58a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:39Z,use_quota=True,user_id='a3c1de48e78c42adb4d8ee2cda95e4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83cade55-bfec-4bb7-8d64-bb0cb2470a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83cade55-bfec-4bb7-8d64-bb0cb2470a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc5d43d-0fcc-4c02-ba11-3295a49bbd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcc5d43d-0fcc-4c02-ba11-3295a49bbd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b2ebd6-5025-4711-96d2-330633e6982a', 'volume_name': 'volume-20b2ebd6-5025-4711-96d2-330633e6982a', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6878623c-2384-40cb-84ca-218510f839a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6878623c-2384-40cb-84ca-218510f839a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af4f30e-abb7-4b57-9bbc-c4fcae99ca84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:38 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Volume 20b2ebd6-5025-4711-96d2-330633e6982a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b2ebd6-5025-4711-96d2-330633e6982a', 'volume_size': 1} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-063c9a96-b800-40c4-a43c-6fce184ca436" released by "_copy_volume_from_snapshot" :: held 7.991s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-203e6927-994f-45b4-bbd2-327f0e11964f-063c9a96-b800-40c4-a43c-6fce184ca436" released by "_create_volume_from_snapshot" :: held 8.074s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.100s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.462s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1570609622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02df045b-357e-41ce-a926-2cc9bb08cec3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20f6afc9630240a8a5c89061e72322ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:34Z,use_quota=True,user_id='9ace90628b7f4c0cabf22e53deadb9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Creating volume 02df045b-357e-41ce-a926-2cc9bb08cec3 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:29:38 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:38 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 1073741824 Feb 26 20:29:38 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c536179-5061-45b7-9d81-497c42fc7bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063c9a96-b800-40c4-a43c-6fce184ca436', 'volume_size': 1, 'snapshot_id': '203e6927-994f-45b4-bbd2-327f0e11964f'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b736fd37-d6b6-44bf-9568-97f816a2c47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:38 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Volume volume-063c9a96-b800-40c4-a43c-6fce184ca436 (063c9a96-b800-40c4-a43c-6fce184ca436): created successfully Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b736fd37-d6b6-44bf-9568-97f816a2c47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Flow 'volume_create_manager' (3ec56905-fb29-49ec-9a8f-31db0165c7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:38 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-92ae7308-3178-4328-8c12-9c84a4c9bf05 tempest-VolumesDeleteCascade-1293554344 None] Created volume successfully. Feb 26 20:29:39 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 1073741824" returned: 0 in 0.590s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:39 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 Feb 26 20:29:39 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:39 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3" returned: 0 in 0.420s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.066s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-489997546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b2ebd6-5025-4711-96d2-330633e6982a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd0a86d3e4ef4977957a7609dc16e58a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:39Z,use_quota=True,user_id='a3c1de48e78c42adb4d8ee2cda95e4e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Creating volume 20b2ebd6-5025-4711-96d2-330633e6982a {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:29:39 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-20b2ebd6-5025-4711-96d2-330633e6982a 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9fd506-9bca-4d95-b900-b5a45e395790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02df045b-357e-41ce-a926-2cc9bb08cec3', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2480f19-366e-4f62-882d-c77b6750bb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:39 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-20b2ebd6-5025-4711-96d2-330633e6982a 1073741824 Feb 26 20:29:39 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-17359a46-3122-426c-8c8b-37cf5c045bfd-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:39 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Volume volume-02df045b-357e-41ce-a926-2cc9bb08cec3 (02df045b-357e-41ce-a926-2cc9bb08cec3): created successfully Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2480f19-366e-4f62-882d-c77b6750bb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Flow 'volume_create_manager' (c567e60e-503c-42d0-a837-a87fcde9b725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:39 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-757af6ba-2e85-4d70-88d3-1421105cf524 tempest-VolumesSnapshotListTestJSON-2061535317 None] Created volume successfully. Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-17359a46-3122-426c-8c8b-37cf5c045bfd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Performing cascade delete. {{(pid=83352) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-203e6927-994f-45b4-bbd2-327f0e11964f-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-203e6927-994f-45b4-bbd2-327f0e11964f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-quobyte-17359a46-3122-426c-8c8b-37cf5c045bfd" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-17359a46-3122-426c-8c8b-37cf5c045bfd" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-quobyte-203e6927-994f-45b4-bbd2-327f0e11964f" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-203e6927-994f-45b4-bbd2-327f0e11964f" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Deleting offline snapshot 203e6927-994f-45b4-bbd2-327f0e11964f of volume 17359a46-3122-426c-8c8b-37cf5c045bfd {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] snapshot_file for this snap is: volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[70491efe-90c7-45ad-93a8-5e8f1498d5d3]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:40 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f Feb 26 20:29:40 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:40 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-20b2ebd6-5025-4711-96d2-330633e6982a 1073741824" returned: 0 in 0.703s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-20b2ebd6-5025-4711-96d2-330633e6982a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:40 devstack sudo[88220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-20b2ebd6-5025-4711-96d2-330633e6982a Feb 26 20:29:40 devstack sudo[88220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:40 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f" returned: 0 in 0.590s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17359a46-3122-426c-8c8b-37cf5c045bfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:40 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5abd65e-4b30-48f1-bf08-c2ace482c350]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:40 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd Feb 26 20:29:40 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:40 devstack sudo[88220]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-20b2ebd6-5025-4711-96d2-330633e6982a" returned: 0 in 0.518s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af4f30e-abb7-4b57-9bbc-c4fcae99ca84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b2ebd6-5025-4711-96d2-330633e6982a', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720958e4-2582-421d-a6a5-b6f0a843ed5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:41 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Volume volume-20b2ebd6-5025-4711-96d2-330633e6982a (20b2ebd6-5025-4711-96d2-330633e6982a): created successfully Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720958e4-2582-421d-a6a5-b6f0a843ed5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Flow 'volume_create_manager' (33938f46-b888-4ec2-b707-2f6cde17e6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:41 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d72aa450-6217-4b28-8e6f-3b6093fb4c3f tempest-VolumesMetadataTest-267848598 None] Created volume successfully. Feb 26 20:29:41 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd" returned: 0 in 0.665s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:41 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f Feb 26 20:29:41 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] Creating offline snapshot 19762c56-b1db-44be-bb15-621b5169ac0f of volume 02df045b-357e-41ce-a926-2cc9bb08cec3 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc37e86d-ddba-4bff-83b3-8cf109a15d80]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:41 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 Feb 26 20:29:41 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:41 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f" returned: 0 in 0.683s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:41 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f Feb 26 20:29:41 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:42 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3" returned: 0 in 0.662s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:42 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f 1G Feb 26 20:29:42 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Acquiring lock "cinder-20b2ebd6-5025-4711-96d2-330633e6982a-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Lock "cinder-20b2ebd6-5025-4711-96d2-330633e6982a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Acquiring lock "cinder-quobyte-20b2ebd6-5025-4711-96d2-330633e6982a" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Lock "cinder-quobyte-20b2ebd6-5025-4711-96d2-330633e6982a" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2b23fd-88dc-4cf5-9769-cc7e644ef379]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-20b2ebd6-5025-4711-96d2-330633e6982a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:42 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd.203e6927-994f-45b4-bbd2-327f0e11964f" returned: 0 in 0.698s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-203e6927-994f-45b4-bbd2-327f0e11964f" released by "_delete_snapshot" :: held 2.717s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-17359a46-3122-426c-8c8b-37cf5c045bfd" released by "delete_snapshot" :: held 2.731s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:42 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-20b2ebd6-5025-4711-96d2-330633e6982a Feb 26 20:29:42 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Created reservations ['d0fa6c82-7dbb-4ace-bc45-46b41fe452ec', 'bf591b76-822d-4f5b-b186-7c092b1caf45', 'eb5b518f-7566-498b-ac71-e95eaaeb578d', 'fab9771d-8c24-4c13-81ea-82bd7d31d089'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:42 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Delete snapshot completed successfully. Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-203e6927-994f-45b4-bbd2-327f0e11964f-delete_snapshot" released by "delete_snapshot" :: held 2.853s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Snapshots deleted, issuing volume delete {{(pid=83352) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-quobyte-17359a46-3122-426c-8c8b-37cf5c045bfd" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-17359a46-3122-426c-8c8b-37cf5c045bfd" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[86440c06-ff35-4c28-9660-e247d27f581b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:42 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f 1G" returned: 0 in 0.851s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02df045b-357e-41ce-a926-2cc9bb08cec3 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:42 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02df045b-357e-41ce-a926-2cc9bb08cec3 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f Feb 26 20:29:42 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:42 devstack sudo[88270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd Feb 26 20:29:42 devstack sudo[88270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:43 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-20b2ebd6-5025-4711-96d2-330633e6982a" returned: 0 in 0.649s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-20b2ebd6-5025-4711-96d2-330633e6982a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:43 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-20b2ebd6-5025-4711-96d2-330633e6982a Feb 26 20:29:43 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:43 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02df045b-357e-41ce-a926-2cc9bb08cec3 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f" returned: 0 in 0.554s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:43 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f is being set with open permissions: ugo+rw Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:43 devstack sudo[88270]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:43 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f Feb 26 20:29:43 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd" returned: 0 in 0.665s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:43 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd Feb 26 20:29:43 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:43 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-20b2ebd6-5025-4711-96d2-330633e6982a" returned: 0 in 0.558s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Lock "cinder-quobyte-20b2ebd6-5025-4711-96d2-330633e6982a" released by "delete_volume" :: held 1.248s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Created reservations ['ef5e756e-5cc8-4bba-bdf5-6ee7e61dda90', 'fafc1bdf-5b15-4dfd-93b3-d43ffee25f64', '2b79f769-1913-4c4a-8081-70c31d4662a0', '6355c9d7-507f-480e-bec4-471d1b4d18b1'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=129,cinder:UPDATE=176,cinder:INSERT=36,cinder:DELETE=12 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:43 devstack sudo[88293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:43 devstack sudo[88293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:43 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f" returned: 0 in 0.563s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:44 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17359a46-3122-426c-8c8b-37cf5c045bfd" returned: 0 in 0.549s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-17359a46-3122-426c-8c8b-37cf5c045bfd" released by "delete_volume" :: held 1.263s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:44 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.info Feb 26 20:29:44 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Created reservations ['47b90f64-1399-41d8-a809-aea4d0b21993', '54fde39d-e0e0-4fc3-bba9-5eeb9127f59e', 'bf9308bc-0569-4bd5-b71c-0251a97fd47d', '43a61d30-5b69-4589-8f18-0c44fc45cd39'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:44 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:44 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:44 devstack sudo[88293]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.523s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:44 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Deleted volume successfully. Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-648eafb3-32bb-48b2-b48c-22ef9c8acf9f tempest-VolumesMetadataTest-267848598 None] Lock "cinder-20b2ebd6-5025-4711-96d2-330633e6982a-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:44 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.info" returned: 0 in 0.475s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:44 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.info is being set with open permissions: ugo+rw Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:44 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.info Feb 26 20:29:44 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:44 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.436s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:44 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Deleted volume successfully. Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=125,cinder:UPDATE=132,cinder:INSERT=45,cinder:DELETE=14 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:29:44 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f0ee72aa-0cac-43d2-b92f-f127aaf0bbe6 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-17359a46-3122-426c-8c8b-37cf5c045bfd-delete_volume" released by "delete_volume" :: held 4.839s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:45 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.info" returned: 0 in 0.530s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.771s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:45 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-73a020b8-dc7a-40fd-ba81-a28d43dfe835 tempest-VolumesSnapshotListTestJSON-2061535317 None] Create snapshot completed successfully Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-063c9a96-b800-40c4-a43c-6fce184ca436-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-063c9a96-b800-40c4-a43c-6fce184ca436-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "cinder-quobyte-063c9a96-b800-40c4-a43c-6fce184ca436" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-063c9a96-b800-40c4-a43c-6fce184ca436" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd06f430-5afd-4463-864b-2ca9f63c464b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:45 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436 Feb 26 20:29:45 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] Creating offline snapshot 136e297e-d063-4a3d-8023-e08220d76e55 of volume 02df045b-357e-41ce-a926-2cc9bb08cec3 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a793f9-38db-4bdc-859f-8d591ff7c67a]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:45 devstack sudo[88308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f Feb 26 20:29:45 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:46 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436" returned: 0 in 0.666s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:46 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436 Feb 26 20:29:46 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:46 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f" returned: 0 in 0.720s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02df045b-357e-41ce-a926-2cc9bb08cec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:46 devstack sudo[88352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 1G Feb 26 20:29:46 devstack sudo[88352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:46 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-063c9a96-b800-40c4-a43c-6fce184ca436" returned: 0 in 0.542s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-quobyte-063c9a96-b800-40c4-a43c-6fce184ca436" released by "delete_volume" :: held 1.237s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Created reservations ['773d6991-c2ac-4c6f-b20d-c2c148246f56', '22bb2ca1-ba11-4913-8055-9ca9ffa72b23', '241168c2-3b9b-4ccc-aa3c-4a388f6aa6c5', 'b558d4b2-98d9-497e-ac33-1fb1c076e0ae'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:46 devstack sudo[88355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:46 devstack sudo[88355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:47 devstack sudo[88352]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 1G" returned: 0 in 0.679s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:47 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 Feb 26 20:29:47 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:47 devstack sudo[88355]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.504s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:47 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:47 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Deleted volume successfully. Feb 26 20:29:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-694ee8fb-fd9c-49e2-8686-326decabab92 tempest-VolumesDeleteCascade-1293554344 None] Lock "cinder-063c9a96-b800-40c4-a43c-6fce184ca436-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:47 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55" returned: 0 in 0.595s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:47 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 is being set with open permissions: ugo+rw Feb 26 20:29:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:47 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 Feb 26 20:29:47 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Flow 'volume_create_manager' (dbe25d7a-e920-4eb7-b23f-350774639433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b98f40-f03c-4c06-bd69-d0f1c98e9b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b98f40-f03c-4c06-bd69-d0f1c98e9b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2127200489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e35897-95fd-4456-a7b1-727389dc2c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be51ca8fef6047faa581459c4e840b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:48Z,use_quota=True,user_id='024af104deaa43d4b8d2f33ed854140b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4a9988-8e4d-418f-abdd-0e09b0adc546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4a9988-8e4d-418f-abdd-0e09b0adc546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72e1130-909c-4f99-a7bf-8aba467380f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72e1130-909c-4f99-a7bf-8aba467380f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0e35897-95fd-4456-a7b1-727389dc2c22', 'volume_name': 'volume-b0e35897-95fd-4456-a7b1-727389dc2c22', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5b046e-c145-4fc9-b7d6-e854e56777dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc5b046e-c145-4fc9-b7d6-e854e56777dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d9c4e5-ae11-44dc-bfca-6316bf9ae90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:48 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Volume b0e35897-95fd-4456-a7b1-727389dc2c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0e35897-95fd-4456-a7b1-727389dc2c22', 'volume_size': 1} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:48 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55" returned: 0 in 0.489s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.544s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.098s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2127200489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0e35897-95fd-4456-a7b1-727389dc2c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be51ca8fef6047faa581459c4e840b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:48Z,use_quota=True,user_id='024af104deaa43d4b8d2f33ed854140b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Creating volume b0e35897-95fd-4456-a7b1-727389dc2c22 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:29:48 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-b0e35897-95fd-4456-a7b1-727389dc2c22 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:48 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-b0e35897-95fd-4456-a7b1-727389dc2c22 1073741824 Feb 26 20:29:48 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:48 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0a1ffcd3-b336-49a8-8f41-27bbfdb90ac4 tempest-VolumesSnapshotListTestJSON-2061535317 None] Create snapshot completed successfully Feb 26 20:29:48 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-b0e35897-95fd-4456-a7b1-727389dc2c22 1073741824" returned: 0 in 0.655s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-b0e35897-95fd-4456-a7b1-727389dc2c22 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:48 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-b0e35897-95fd-4456-a7b1-727389dc2c22 Feb 26 20:29:48 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:49 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-b0e35897-95fd-4456-a7b1-727389dc2c22" returned: 0 in 0.619s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:29:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.583s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2d9c4e5-ae11-44dc-bfca-6316bf9ae90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0e35897-95fd-4456-a7b1-727389dc2c22', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4e5882-fcc1-44ce-bd03-aa80add45bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] Creating offline snapshot 49be3481-7946-421e-a5d4-43735c147516 of volume 02df045b-357e-41ce-a926-2cc9bb08cec3 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:29:49 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Volume volume-b0e35897-95fd-4456-a7b1-727389dc2c22 (b0e35897-95fd-4456-a7b1-727389dc2c22): created successfully Feb 26 20:29:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4e5882-fcc1-44ce-bd03-aa80add45bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Flow 'volume_create_manager' (dbe25d7a-e920-4eb7-b23f-350774639433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:49 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d05fa5a-9d7d-4dbe-adb7-4199694b3f29]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:49 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a6ef5487-048f-4cc7-a09f-dcae3884eb57 tempest-VolumesTransfersV355Test-1179111335 None] Created volume successfully. Feb 26 20:29:49 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 Feb 26 20:29:49 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:50 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55" returned: 0 in 0.684s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02df045b-357e-41ce-a926-2cc9bb08cec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:50 devstack sudo[88384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 1G Feb 26 20:29:50 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:50 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-22edf3d8-a71d-4534-bbb0-43b68ee4dc77 tempest-VolumesTransfersV355Test-519554327 None] Transfer volume completed successfully. Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Flow 'volume_create_manager' (31c572b0-f92a-40b1-8cb9-2fcdca41bf0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec13407-657e-4037-9df7-25316aa8221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec13407-657e-4037-9df7-25316aa8221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1628945528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72688ea9-d4c8-4437-aed1-a36352fb0715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823be5e027b6492fb0193d5bedb37ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:51Z,use_quota=True,user_id='65f2ffaa5d2047148f0161e6ccc5026c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e79559c-6294-4c8f-bcd5-afdd6984ba9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:51 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e79559c-6294-4c8f-bcd5-afdd6984ba9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951a9515-66cf-4bf4-ab76-e2b3631068bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951a9515-66cf-4bf4-ab76-e2b3631068bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72688ea9-d4c8-4437-aed1-a36352fb0715', 'volume_name': 'volume-72688ea9-d4c8-4437-aed1-a36352fb0715', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7477dbd3-6194-48cb-a3cd-c927b0b470c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7477dbd3-6194-48cb-a3cd-c927b0b470c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ece9f7-83aa-4d41-98d5-785d186f694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:51 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Volume 72688ea9-d4c8-4437-aed1-a36352fb0715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72688ea9-d4c8-4437-aed1-a36352fb0715', 'volume_size': 1} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 1G" returned: 0 in 0.783s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:51 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 Feb 26 20:29:51 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:51 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516" returned: 0 in 0.553s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:51 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 is being set with open permissions: ugo+rw Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:51 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 Feb 26 20:29:51 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Acquiring lock "cinder-b0e35897-95fd-4456-a7b1-727389dc2c22-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Lock "cinder-b0e35897-95fd-4456-a7b1-727389dc2c22-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Acquiring lock "cinder-quobyte-b0e35897-95fd-4456-a7b1-727389dc2c22" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Lock "cinder-quobyte-b0e35897-95fd-4456-a7b1-727389dc2c22" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5cb9f7-4225-4bd3-a13f-34fd8c761eb3]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-b0e35897-95fd-4456-a7b1-727389dc2c22 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:52 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-b0e35897-95fd-4456-a7b1-727389dc2c22 Feb 26 20:29:52 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:52 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516" returned: 0 in 0.538s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.676s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.132s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1628945528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72688ea9-d4c8-4437-aed1-a36352fb0715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823be5e027b6492fb0193d5bedb37ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:51Z,use_quota=True,user_id='65f2ffaa5d2047148f0161e6ccc5026c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Creating volume 72688ea9-d4c8-4437-aed1-a36352fb0715 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:29:52 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-72688ea9-d4c8-4437-aed1-a36352fb0715 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:52 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-72688ea9-d4c8-4437-aed1-a36352fb0715 1073741824 Feb 26 20:29:52 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:52 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-279a4cf3-3fb6-4c5b-99f8-253b22bcaa44 tempest-VolumesSnapshotListTestJSON-2061535317 None] Create snapshot completed successfully Feb 26 20:29:52 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-b0e35897-95fd-4456-a7b1-727389dc2c22" returned: 0 in 0.556s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-b0e35897-95fd-4456-a7b1-727389dc2c22 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:52 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-b0e35897-95fd-4456-a7b1-727389dc2c22 Feb 26 20:29:52 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:52 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-72688ea9-d4c8-4437-aed1-a36352fb0715 1073741824" returned: 0 in 0.620s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-72688ea9-d4c8-4437-aed1-a36352fb0715 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:52 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-72688ea9-d4c8-4437-aed1-a36352fb0715 Feb 26 20:29:52 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:53 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-b0e35897-95fd-4456-a7b1-727389dc2c22" returned: 0 in 0.610s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Lock "cinder-quobyte-b0e35897-95fd-4456-a7b1-727389dc2c22" released by "delete_volume" :: held 1.197s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Created reservations ['b4612ea2-2823-481e-b0dd-9cddcf7a00e2', 'df380d4c-4842-4285-9b15-bb468241805d', '332fe6ac-909f-4737-b622-e371b689abf7', 'c402e90e-9cc6-4f60-8911-f902d05cbd9d'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:53 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:53 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:53 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-72688ea9-d4c8-4437-aed1-a36352fb0715" returned: 0 in 0.579s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60ece9f7-83aa-4d41-98d5-785d186f694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72688ea9-d4c8-4437-aed1-a36352fb0715', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbc14d2-74da-49f3-939b-5bf982c5442d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:53 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Volume volume-72688ea9-d4c8-4437-aed1-a36352fb0715 (72688ea9-d4c8-4437-aed1-a36352fb0715): created successfully Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbbc14d2-74da-49f3-939b-5bf982c5442d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Flow 'volume_create_manager' (31c572b0-f92a-40b1-8cb9-2fcdca41bf0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:53 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e03338b3-20be-4045-9b6d-7726ebe08005 tempest-VolumesTransfersTest-526541749 None] Created volume successfully. Feb 26 20:29:53 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.616s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:53 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Deleted volume successfully. Feb 26 20:29:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1e26980a-75c7-4bef-9adc-a4fda4cbca98 tempest-VolumesTransfersV355Test-1415881722 None] Lock "cinder-b0e35897-95fd-4456-a7b1-727389dc2c22-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "cinder-49be3481-7946-421e-a5d4-43735c147516-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-49be3481-7946-421e-a5d4-43735c147516-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "cinder-quobyte-02df045b-357e-41ce-a926-2cc9bb08cec3" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-02df045b-357e-41ce-a926-2cc9bb08cec3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "cinder-quobyte-49be3481-7946-421e-a5d4-43735c147516" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-49be3481-7946-421e-a5d4-43735c147516" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Deleting offline snapshot 49be3481-7946-421e-a5d4-43735c147516 of volume 02df045b-357e-41ce-a926-2cc9bb08cec3 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] snapshot_file for this snap is: volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[5282b7f7-6325-4310-9f19-22f234ab7564]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:54 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 Feb 26 20:29:54 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Flow 'volume_create_manager' (fbd9ef0b-fedf-432c-b45c-cd88e51c9238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe1505b-bc5b-4502-b0d4-c67bf2632d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fe1505b-bc5b-4502-b0d4-c67bf2632d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1366548652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d93b46-e44a-4417-8bae-f5a83b65e63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be51ca8fef6047faa581459c4e840b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:55Z,use_quota=True,user_id='024af104deaa43d4b8d2f33ed854140b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e201c3c2-f58d-49ec-8f45-4bdd914c3ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e201c3c2-f58d-49ec-8f45-4bdd914c3ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9102c4d3-3bbb-41cd-b74d-873522b28811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9102c4d3-3bbb-41cd-b74d-873522b28811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d93b46-e44a-4417-8bae-f5a83b65e63e', 'volume_name': 'volume-80d93b46-e44a-4417-8bae-f5a83b65e63e', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe823b0-7d6b-47cb-9494-2eb415f1510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbe823b0-7d6b-47cb-9494-2eb415f1510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014085b6-b794-43ac-a441-173697767fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:54 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Volume 80d93b46-e44a-4417-8bae-f5a83b65e63e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d93b46-e44a-4417-8bae-f5a83b65e63e', 'volume_size': 1} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1366548652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d93b46-e44a-4417-8bae-f5a83b65e63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be51ca8fef6047faa581459c4e840b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:55Z,use_quota=True,user_id='024af104deaa43d4b8d2f33ed854140b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Creating volume 80d93b46-e44a-4417-8bae-f5a83b65e63e {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:29:54 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-80d93b46-e44a-4417-8bae-f5a83b65e63e 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:54 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-80d93b46-e44a-4417-8bae-f5a83b65e63e 1073741824 Feb 26 20:29:54 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:54 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516" returned: 0 in 0.817s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02df045b-357e-41ce-a926-2cc9bb08cec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c573a77e-49b0-4560-9b1d-f2265577524f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:55 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-4eb83815-68fc-4da9-ac53-206f18474735 tempest-VolumesTransfersTest-699573345 None] Transfer volume completed successfully. Feb 26 20:29:55 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 Feb 26 20:29:55 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:55 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-80d93b46-e44a-4417-8bae-f5a83b65e63e 1073741824" returned: 0 in 0.612s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-80d93b46-e44a-4417-8bae-f5a83b65e63e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:55 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-80d93b46-e44a-4417-8bae-f5a83b65e63e Feb 26 20:29:55 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:55 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55" returned: 0 in 0.667s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02df045b-357e-41ce-a926-2cc9bb08cec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:55 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 Feb 26 20:29:55 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:55 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-80d93b46-e44a-4417-8bae-f5a83b65e63e" returned: 0 in 0.529s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (014085b6-b794-43ac-a441-173697767fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d93b46-e44a-4417-8bae-f5a83b65e63e', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e7b774-c896-4474-bf2a-09abbc86ab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:55 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Volume volume-80d93b46-e44a-4417-8bae-f5a83b65e63e (80d93b46-e44a-4417-8bae-f5a83b65e63e): created successfully Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86e7b774-c896-4474-bf2a-09abbc86ab5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Flow 'volume_create_manager' (fbd9ef0b-fedf-432c-b45c-cd88e51c9238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:55 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3a968281-6ae2-41a0-8ee2-fee227a4466f tempest-VolumesTransfersV355Test-1179111335 None] Created volume successfully. Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Acquiring lock "cinder-72688ea9-d4c8-4437-aed1-a36352fb0715-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Lock "cinder-72688ea9-d4c8-4437-aed1-a36352fb0715-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Acquiring lock "cinder-quobyte-72688ea9-d4c8-4437-aed1-a36352fb0715" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Lock "cinder-quobyte-72688ea9-d4c8-4437-aed1-a36352fb0715" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8841d4-cd19-4c77-95e8-2b099339464b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-72688ea9-d4c8-4437-aed1-a36352fb0715 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:56 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-72688ea9-d4c8-4437-aed1-a36352fb0715 Feb 26 20:29:56 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:56 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516" returned: 0 in 0.622s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:56 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516 Feb 26 20:29:56 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:56 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-72688ea9-d4c8-4437-aed1-a36352fb0715" returned: 0 in 0.609s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-72688ea9-d4c8-4437-aed1-a36352fb0715 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:56 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-72688ea9-d4c8-4437-aed1-a36352fb0715 Feb 26 20:29:56 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:56 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.49be3481-7946-421e-a5d4-43735c147516" returned: 0 in 0.515s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-49be3481-7946-421e-a5d4-43735c147516" released by "_delete_snapshot" :: held 2.722s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-02df045b-357e-41ce-a926-2cc9bb08cec3" released by "delete_snapshot" :: held 2.749s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:56 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Created reservations ['120820ef-caee-4f3e-9647-aa9bd0ff02d5', '68f0460e-183f-49db-9bc6-b9d1bceea147', '3b2cc376-307a-4361-baeb-27df9f63f496', 'f64a43d6-26a3-4708-8869-09d4a8f66e5c'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:56 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Delete snapshot completed successfully. Feb 26 20:29:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-513b1f6c-a45d-447a-946e-20048ec8c27a tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-49be3481-7946-421e-a5d4-43735c147516-delete_snapshot" released by "delete_snapshot" :: held 2.874s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Acquiring lock "cinder-80d93b46-e44a-4417-8bae-f5a83b65e63e-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Lock "cinder-80d93b46-e44a-4417-8bae-f5a83b65e63e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Acquiring lock "cinder-quobyte-80d93b46-e44a-4417-8bae-f5a83b65e63e" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Lock "cinder-quobyte-80d93b46-e44a-4417-8bae-f5a83b65e63e" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[475a67f0-7b17-4ea2-afc4-f9da3f958b4c]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-80d93b46-e44a-4417-8bae-f5a83b65e63e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:57 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-80d93b46-e44a-4417-8bae-f5a83b65e63e Feb 26 20:29:57 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "cinder-136e297e-d063-4a3d-8023-e08220d76e55-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:57 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-72688ea9-d4c8-4437-aed1-a36352fb0715" returned: 0 in 0.620s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-136e297e-d063-4a3d-8023-e08220d76e55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "cinder-quobyte-02df045b-357e-41ce-a926-2cc9bb08cec3" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Lock "cinder-quobyte-72688ea9-d4c8-4437-aed1-a36352fb0715" released by "delete_volume" :: held 1.265s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-02df045b-357e-41ce-a926-2cc9bb08cec3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "cinder-quobyte-136e297e-d063-4a3d-8023-e08220d76e55" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Created reservations ['e413e24e-1761-4c04-bcb9-c30d7f72541d', '333a20f6-e751-44de-99cc-e6018450bb98', '6b73ca53-ca2a-4151-827d-93d7a557be62', '7530fb1d-9813-4cd8-8af3-cb3455090f47'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-136e297e-d063-4a3d-8023-e08220d76e55" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Deleting offline snapshot 136e297e-d063-4a3d-8023-e08220d76e55 of volume 02df045b-357e-41ce-a926-2cc9bb08cec3 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] snapshot_file for this snap is: volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cfc863-d7a7-47ca-977e-378d86587c22]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:57 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 Feb 26 20:29:57 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:57 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:57 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:57 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-80d93b46-e44a-4417-8bae-f5a83b65e63e" returned: 0 in 0.597s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-80d93b46-e44a-4417-8bae-f5a83b65e63e {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:57 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-80d93b46-e44a-4417-8bae-f5a83b65e63e Feb 26 20:29:57 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:58 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55" returned: 0 in 0.728s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02df045b-357e-41ce-a926-2cc9bb08cec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb516cb-77bb-4828-a3fb-88242b92f25c]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:58 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.695s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:58 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Deleted volume successfully. Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e4d9760e-fb0f-42e6-bce7-cf1732636275 tempest-VolumesTransfersTest-149093331 None] Lock "cinder-72688ea9-d4c8-4437-aed1-a36352fb0715-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:58 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f Feb 26 20:29:58 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:58 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-80d93b46-e44a-4417-8bae-f5a83b65e63e" returned: 0 in 0.621s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Lock "cinder-quobyte-80d93b46-e44a-4417-8bae-f5a83b65e63e" released by "delete_volume" :: held 1.252s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Created reservations ['e104cae7-9538-47c0-98f4-efb732982780', 'c9efb1bc-60e0-4a07-b46c-c3de38cd8b68', '98ec6079-5a14-403f-bc08-3c7d56d7c407', '7729f1ea-0472-414d-85fe-4f763f3fd35a'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:58 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:29:58 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Flow 'volume_create_manager' (c3c538a6-3fe4-4574-bec6-383a5eca02b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e221d6-9dcc-45ce-887e-07e96d434237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e221d6-9dcc-45ce-887e-07e96d434237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-481230612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9183eae4-003e-44f1-9218-57e3f56043de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823be5e027b6492fb0193d5bedb37ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:59Z,use_quota=True,user_id='65f2ffaa5d2047148f0161e6ccc5026c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0462296e-9620-46e6-be34-ac01db8d2f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0462296e-9620-46e6-be34-ac01db8d2f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c0f8f2-1612-4af8-8185-00bc84873935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c0f8f2-1612-4af8-8185-00bc84873935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9183eae4-003e-44f1-9218-57e3f56043de', 'volume_name': 'volume-9183eae4-003e-44f1-9218-57e3f56043de', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8edb623e-d0de-4757-8494-1190ab68cf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8edb623e-d0de-4757-8494-1190ab68cf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a88812d-da44-4362-bfd5-98bb1ea2c3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:29:58 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Volume 9183eae4-003e-44f1-9218-57e3f56043de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9183eae4-003e-44f1-9218-57e3f56043de', 'volume_size': 1} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-481230612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9183eae4-003e-44f1-9218-57e3f56043de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='823be5e027b6492fb0193d5bedb37ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:29:59Z,use_quota=True,user_id='65f2ffaa5d2047148f0161e6ccc5026c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Creating volume 9183eae4-003e-44f1-9218-57e3f56043de {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:29:58 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9183eae4-003e-44f1-9218-57e3f56043de 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:58 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9183eae4-003e-44f1-9218-57e3f56043de 1073741824 Feb 26 20:29:58 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:58 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f" returned: 0 in 0.711s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02df045b-357e-41ce-a926-2cc9bb08cec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:29:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:58 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 Feb 26 20:29:58 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:58 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.606s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:59 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:29:59 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Deleted volume successfully. Feb 26 20:29:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9d3782c7-2eea-4849-924c-12c7ae20a3f1 tempest-VolumesTransfersV355Test-1415881722 None] Lock "cinder-80d93b46-e44a-4417-8bae-f5a83b65e63e-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:29:59 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9183eae4-003e-44f1-9218-57e3f56043de 1073741824" returned: 0 in 0.731s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9183eae4-003e-44f1-9218-57e3f56043de {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:59 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9183eae4-003e-44f1-9218-57e3f56043de Feb 26 20:29:59 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:59 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55" returned: 0 in 0.796s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:29:59 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55 Feb 26 20:29:59 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:29:59 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Feb 26 20:29:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9183eae4-003e-44f1-9218-57e3f56043de" returned: 0 in 0.526s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:29:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:29:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:29:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a88812d-da44-4362-bfd5-98bb1ea2c3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9183eae4-003e-44f1-9218-57e3f56043de', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:29:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c01c4ad-f531-4bc4-9086-24b52aa163c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:00 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Volume volume-9183eae4-003e-44f1-9218-57e3f56043de (9183eae4-003e-44f1-9218-57e3f56043de): created successfully Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c01c4ad-f531-4bc4-9086-24b52aa163c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Flow 'volume_create_manager' (c3c538a6-3fe4-4574-bec6-383a5eca02b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:00 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-539f3e6c-8d4a-40f6-91f0-711c5f05dcee tempest-VolumesTransfersTest-526541749 None] Created volume successfully. Feb 26 20:30:00 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.136e297e-d063-4a3d-8023-e08220d76e55" returned: 0 in 0.631s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-136e297e-d063-4a3d-8023-e08220d76e55" released by "_delete_snapshot" :: held 2.929s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-02df045b-357e-41ce-a926-2cc9bb08cec3" released by "delete_snapshot" :: held 2.958s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Created reservations ['c9df1344-bb62-431d-9394-2bcafb7ab554', 'be354733-e693-49c6-862a-36aba9233f51', '5979e295-b233-4d55-9e7d-8ee5cff211cc', '9a6c4572-afee-4ee6-9bca-8b16ac6beec1'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:00 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Delete snapshot completed successfully. Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e649e92a-337a-43d8-a93a-8786f2c0b653 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-136e297e-d063-4a3d-8023-e08220d76e55-delete_snapshot" released by "delete_snapshot" :: held 3.087s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "cinder-19762c56-b1db-44be-bb15-621b5169ac0f-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-19762c56-b1db-44be-bb15-621b5169ac0f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "cinder-quobyte-02df045b-357e-41ce-a926-2cc9bb08cec3" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-02df045b-357e-41ce-a926-2cc9bb08cec3" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "cinder-quobyte-19762c56-b1db-44be-bb15-621b5169ac0f" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-19762c56-b1db-44be-bb15-621b5169ac0f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Deleting offline snapshot 19762c56-b1db-44be-bb15-621b5169ac0f of volume 02df045b-357e-41ce-a926-2cc9bb08cec3 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] snapshot_file for this snap is: volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[059cf804-3d6d-46f7-bbed-ee2290a1ea39]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:00 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f Feb 26 20:30:00 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Acquiring lock "cinder-9183eae4-003e-44f1-9218-57e3f56043de-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Lock "cinder-9183eae4-003e-44f1-9218-57e3f56043de-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Acquiring lock "cinder-quobyte-9183eae4-003e-44f1-9218-57e3f56043de" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Lock "cinder-quobyte-9183eae4-003e-44f1-9218-57e3f56043de" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:01 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7150950-8c73-4c1a-aff5-f1bbb885baad]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9183eae4-003e-44f1-9218-57e3f56043de {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:01 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9183eae4-003e-44f1-9218-57e3f56043de Feb 26 20:30:01 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:01 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f" returned: 0 in 0.916s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02df045b-357e-41ce-a926-2cc9bb08cec3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:30:01 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[955f204c-4448-483e-9c46-77dcd1d454dc]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:01 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 Feb 26 20:30:01 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:01 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9183eae4-003e-44f1-9218-57e3f56043de" returned: 0 in 0.612s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9183eae4-003e-44f1-9218-57e3f56043de {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:01 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9183eae4-003e-44f1-9218-57e3f56043de Feb 26 20:30:01 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:02 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3" returned: 0 in 0.703s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:02 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f Feb 26 20:30:02 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:02 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9183eae4-003e-44f1-9218-57e3f56043de" returned: 0 in 0.558s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Lock "cinder-quobyte-9183eae4-003e-44f1-9218-57e3f56043de" released by "delete_volume" :: held 1.216s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Created reservations ['a7ee1d54-e4d5-4b9b-86a6-3733d7bf55a0', '834d0617-967d-4b5e-9511-56bf0ebc4ab6', '59cdb83e-94b1-4542-870e-436ee8af3bb7', '3baf092e-8e91-4e60-9529-b318637fd0fe'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:02 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:02 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:02 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f" returned: 0 in 0.663s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:02 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f Feb 26 20:30:02 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:03 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.622s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:03 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:03 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Deleted volume successfully. Feb 26 20:30:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2953a2df-efe3-4a52-b796-12f671b93358 tempest-VolumesTransfersTest-149093331 None] Lock "cinder-9183eae4-003e-44f1-9218-57e3f56043de-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:03 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3.19762c56-b1db-44be-bb15-621b5169ac0f" returned: 0 in 0.613s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-19762c56-b1db-44be-bb15-621b5169ac0f" released by "_delete_snapshot" :: held 2.993s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-02df045b-357e-41ce-a926-2cc9bb08cec3" released by "delete_snapshot" :: held 3.012s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:03 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Created reservations ['98e26cb6-3f94-4128-8dbf-45b62dcc7ef2', 'c60b2271-0fac-4aba-a18c-d4a340224e1f', '32d0278d-dc05-44f9-8c6c-2166b2b72ec1', '22bad25e-c9c0-4624-b09d-76057398101d'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:03 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Delete snapshot completed successfully. Feb 26 20:30:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dc450d0b-f41b-4419-96ca-dd0bfe8af76a tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-19762c56-b1db-44be-bb15-621b5169ac0f-delete_snapshot" released by "delete_snapshot" :: held 3.144s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "cinder-02df045b-357e-41ce-a926-2cc9bb08cec3-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-02df045b-357e-41ce-a926-2cc9bb08cec3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "cinder-quobyte-02df045b-357e-41ce-a926-2cc9bb08cec3" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-02df045b-357e-41ce-a926-2cc9bb08cec3" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:04 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b965813d-4af0-4818-9523-163ec2aec315]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:04 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 Feb 26 20:30:04 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Flow 'volume_create_manager' (9c3ffa56-2719-422b-a161-2425cac033fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597c8d97-d2fc-42ca-831c-0fc6e7d1bb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597c8d97-d2fc-42ca-831c-0fc6e7d1bb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1230591516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef569b49-d9f1-4b8f-8d70-9e30494fab35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e627ef17ca48fe9212b1095d06367b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:05Z,use_quota=True,user_id='fa008fec1dc24751adc526cc0b27c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864c32d3-d5da-4dde-9409-819fea464765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864c32d3-d5da-4dde-9409-819fea464765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8602ce-1089-4ad4-8c09-e15ab74b3a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.image.glance [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Creating Keystone auth plugin from conf {{(pid=83352) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 26 20:30:05 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3" returned: 0 in 0.650s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:05 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3 Feb 26 20:30:05 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f8602ce-1089-4ad4-8c09-e15ab74b3a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef569b49-d9f1-4b8f-8d70-9e30494fab35', 'volume_name': 'volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35', 'volume_size': 1, 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9cc93d85d98d418bb1b53f2c8bbda0ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'created_at': datetime.datetime(2026, 2, 26, 19, 20, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 19, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2058e89-3841-4db7-83b1-74c4d1464ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2058e89-3841-4db7-83b1-74c4d1464ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f6a3bc-e451-460a-9686-1105685ba297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:05 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Volume ef569b49-d9f1-4b8f-8d70-9e30494fab35: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35', 'volume_size': 1, 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9cc93d85d98d418bb1b53f2c8bbda0ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'created_at': datetime.datetime(2026, 2, 26, 19, 20, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 19, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Trying to clone ef569b49-d9f1-4b8f-8d70-9e30494fab35 from image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]). {{(pid=83352) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 26 20:30:05 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83352) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 26 20:30:05 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Image download 20.69 MB at 20.69 MB/s Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb08324-87cb-4bb9-ae9f-bc37b587dc74]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:06 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD Feb 26 20:30:06 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:06 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-02df045b-357e-41ce-a926-2cc9bb08cec3" returned: 0 in 0.788s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-quobyte-02df045b-357e-41ce-a926-2cc9bb08cec3" released by "delete_volume" :: held 1.496s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Created reservations ['f5664950-51bc-4a6a-8fe8-2ef7f00e9241', 'a0451089-2278-4c2e-ac73-ced5923e32a7', '2d79fe78-2ef9-444e-95f8-b6771def8699', 'b5159aa7-5f6e-4876-9faa-8d5d22c30f1d'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:06 devstack sudo[88539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:06 devstack sudo[88539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:06 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD" returned: 0 in 0.695s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Temporary image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 is fetched for user fa008fec1dc24751adc526cc0b27c435. {{(pid=83352) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1edb77-8a21-4334-a7d5-e7c2d63f112e]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:06 devstack sudo[88539]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.508s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:06 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Deleted volume successfully. Feb 26 20:30:06 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2578c647-0625-453d-bd81-d397fac78a54 tempest-VolumesSnapshotListTestJSON-2061535317 None] Lock "cinder-02df045b-357e-41ce-a926-2cc9bb08cec3-delete_volume" released by "delete_volume" :: held 2.211s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:06 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD Feb 26 20:30:06 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:07 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD" returned: 0 in 0.711s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1230591516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef569b49-d9f1-4b8f-8d70-9e30494fab35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e627ef17ca48fe9212b1095d06367b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:05Z,use_quota=True,user_id='fa008fec1dc24751adc526cc0b27c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Creating volume ef569b49-d9f1-4b8f-8d70-9e30494fab35 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:07 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:07 devstack sudo[88550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 1073741824 Feb 26 20:30:07 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:08 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 1073741824" returned: 0 in 0.690s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:08 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 Feb 26 20:30:08 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Flow 'volume_create_manager' (ffc30f88-5da0-440c-89d8-674ce378583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1b3d8e-04fc-418d-b7fd-35fffb64fd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1b3d8e-04fc-418d-b7fd-35fffb64fd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-576274685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac0a5d7-d11a-493e-b7aa-40835574bf05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd4fc80b20a4a30a6829ff4f20f3c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:08Z,use_quota=True,user_id='7c69181389d44371ba36874f6510f7b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b289731-8c56-4803-9f30-c7c6caf549bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b289731-8c56-4803-9f30-c7c6caf549bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8cc55d-462e-456a-b0c7-fdb8f45e591e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8cc55d-462e-456a-b0c7-fdb8f45e591e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eac0a5d7-d11a-493e-b7aa-40835574bf05', 'volume_name': 'volume-eac0a5d7-d11a-493e-b7aa-40835574bf05', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc06f09-e512-4e1b-b0dc-d82413e92b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc06f09-e512-4e1b-b0dc-d82413e92b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db82653-e5b7-41e4-80aa-0424a6630599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:08 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Volume eac0a5d7-d11a-493e-b7aa-40835574bf05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eac0a5d7-d11a-493e-b7aa-40835574bf05', 'volume_size': 1} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:08 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35" returned: 0 in 0.563s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.346s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-576274685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eac0a5d7-d11a-493e-b7aa-40835574bf05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd4fc80b20a4a30a6829ff4f20f3c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:08Z,use_quota=True,user_id='7c69181389d44371ba36874f6510f7b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Creating volume eac0a5d7-d11a-493e-b7aa-40835574bf05 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:08 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG cinder.volume.volume_utils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Attempting download of 8dcf692b-f75b-4a29-963c-f59ebe841cf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}])) to volume ef569b49-d9f1-4b8f-8d70-9e30494fab35. {{(pid=83352) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 26 20:30:08 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 1073741824 Feb 26 20:30:08 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cb91d1-2f4b-4e9a-b74c-a5732e54886b]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_digbu8xi {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:09 devstack sudo[88560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_digbu8xi Feb 26 20:30:09 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Flow 'volume_create_manager' (e10f84a1-5aae-46ce-a198-1b206ae670fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1b2c10-2219-4ce0-8581-acac3664d4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1b2c10-2219-4ce0-8581-acac3664d4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-70673519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0176c0e-259d-432c-bb14-8d9feab3e8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b992bb422f145baa954d36ebf0e5e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:09Z,use_quota=True,user_id='f372ea53b4024ffb9f0dfdf9f32561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2c329e-5b4f-4beb-9ab2-efee31d2dc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e2c329e-5b4f-4beb-9ab2-efee31d2dc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d6df6a-a636-4a58-89b1-c90ae5b1498d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d6df6a-a636-4a58-89b1-c90ae5b1498d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0176c0e-259d-432c-bb14-8d9feab3e8b8', 'volume_name': 'volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbc4f62-1019-4852-842f-dbaeb21fdf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbc4f62-1019-4852-842f-dbaeb21fdf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d822d32-2147-47ba-a7df-ded9a734523c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:09 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Volume d0176c0e-259d-432c-bb14-8d9feab3e8b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8', 'volume_size': 1} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:09 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_digbu8xi" returned: 0 in 0.674s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_digbu8xi {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:09 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 1073741824" returned: 0 in 0.759s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:09 devstack sudo[88569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 Feb 26 20:30:09 devstack sudo[88569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:09 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_digbu8xi Feb 26 20:30:09 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Flow 'volume_create_manager' (72ede161-acd2-4bc9-94f8-d798adccf259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a3a138-1479-40b8-b425-6cf9e3db217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a3a138-1479-40b8-b425-6cf9e3db217c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1392610006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8f5f18-db1c-4f58-83b0-58690d8f407f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b992bb422f145baa954d36ebf0e5e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:10Z,use_quota=True,user_id='f372ea53b4024ffb9f0dfdf9f32561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129a9921-1dce-491e-b635-3b18d7221f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129a9921-1dce-491e-b635-3b18d7221f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402e5e3f-4f97-4b90-985a-290365ce8e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402e5e3f-4f97-4b90-985a-290365ce8e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd8f5f18-db1c-4f58-83b0-58690d8f407f', 'volume_name': 'volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e055ca0-aab9-4195-974a-9fbf81830f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e055ca0-aab9-4195-974a-9fbf81830f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6559218-6aed-4d08-97d4-35178aacd6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Volume dd8f5f18-db1c-4f58-83b0-58690d8f407f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f', 'volume_size': 1} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Flow 'volume_create_manager' (8514557d-9d55-4f36-befc-a2a214cd1324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69224954-2c74-4c13-b6ed-0f99ae39b42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69224954-2c74-4c13-b6ed-0f99ae39b42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326593626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b3c3f2-1f42-486f-b49c-c944d7195c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b992bb422f145baa954d36ebf0e5e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:10Z,use_quota=True,user_id='f372ea53b4024ffb9f0dfdf9f32561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bbd05a-244c-407e-abd9-537bf8515150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bbd05a-244c-407e-abd9-537bf8515150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4e98c9-7f91-4fd4-825e-5b757ce390f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a4e98c9-7f91-4fd4-825e-5b757ce390f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b3c3f2-1f42-486f-b49c-c944d7195c67', 'volume_name': 'volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53f5ffc-4b8b-4a77-b7f1-dfe95670eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53f5ffc-4b8b-4a77-b7f1-dfe95670eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77914da7-7e8b-465d-ae34-14052a7a2df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Volume c7b3c3f2-1f42-486f-b49c-c944d7195c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67', 'volume_size': 1} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:10 devstack sudo[88569]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05" returned: 0 in 0.667s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-70673519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0176c0e-259d-432c-bb14-8d9feab3e8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b992bb422f145baa954d36ebf0e5e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:09Z,use_quota=True,user_id='f372ea53b4024ffb9f0dfdf9f32561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Creating volume d0176c0e-259d-432c-bb14-8d9feab3e8b8 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:10 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:10 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8 1073741824 Feb 26 20:30:10 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db82653-e5b7-41e4-80aa-0424a6630599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eac0a5d7-d11a-493e-b7aa-40835574bf05', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfccbefd-0d5e-408b-895c-ed63a2834f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Flow 'volume_create_manager' (af57d348-d0d9-4947-8fb3-16d546dd1c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12f9b11-eb0e-4320-a770-3742a386d05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Volume volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 (eac0a5d7-d11a-493e-b7aa-40835574bf05): created successfully Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfccbefd-0d5e-408b-895c-ed63a2834f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Flow 'volume_create_manager' (ffc30f88-5da0-440c-89d8-674ce378583a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:10 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a3b0689a-d069-4855-966d-b4b736600b44 tempest-VolumesCloneTest-328567630 None] Created volume successfully. Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12f9b11-eb0e-4320-a770-3742a386d05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1796214137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465e1cef-001c-4d94-be7a-0712df6062f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b992bb422f145baa954d36ebf0e5e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:10Z,use_quota=True,user_id='f372ea53b4024ffb9f0dfdf9f32561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d53d25-bb89-4170-833c-1952581ad474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69d53d25-bb89-4170-833c-1952581ad474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923d10f4-6f75-403e-bd76-2e65eabd215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923d10f4-6f75-403e-bd76-2e65eabd215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '465e1cef-001c-4d94-be7a-0712df6062f0', 'volume_name': 'volume-465e1cef-001c-4d94-be7a-0712df6062f0', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5d9e97-631f-4b5e-b43f-813051798da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5d9e97-631f-4b5e-b43f-813051798da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cf950c-47a1-4d4b-b1cf-6e435f1c910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Volume 465e1cef-001c-4d94-be7a-0712df6062f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-465e1cef-001c-4d94-be7a-0712df6062f0', 'volume_size': 1} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_digbu8xi" returned: 1 in 0.940s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_digbu8xi' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b67e42-8122-4301-9ab4-b1d987020447]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:10 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD Feb 26 20:30:10 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Flow 'volume_create_manager' (87d9d819-4cc7-4167-9547-9ad06f1234d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44fe011-f056-4f84-8289-2b34c65de822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44fe011-f056-4f84-8289-2b34c65de822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1613641344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78207a8-e22b-4ddd-93d7-cbbcb1e05a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b992bb422f145baa954d36ebf0e5e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:11Z,use_quota=True,user_id='f372ea53b4024ffb9f0dfdf9f32561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc84a130-d41b-49d3-8508-ac2621ca9961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc84a130-d41b-49d3-8508-ac2621ca9961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8423069-7b06-4f19-aba2-6b3288539b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8423069-7b06-4f19-aba2-6b3288539b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c78207a8-e22b-4ddd-93d7-cbbcb1e05a91', 'volume_name': 'volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc56153c-b822-4baf-a3be-9d58598014ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc56153c-b822-4baf-a3be-9d58598014ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57a95a6-e24f-48f8-a980-958ba0c056a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:10 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Volume c78207a8-e22b-4ddd-93d7-cbbcb1e05a91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91', 'volume_size': 1} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Flow 'volume_create_manager' (4ce653ee-05c8-4708-b45c-1f64249b0067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6ea550-e924-4d2a-9887-5554662b5b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac6ea550-e924-4d2a-9887-5554662b5b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-36941075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbba064-ad63-4463-a2ba-1f669c2f86fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddd4fc80b20a4a30a6829ff4f20f3c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=eac0a5d7-d11a-493e-b7aa-40835574bf05,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:11Z,use_quota=True,user_id='7c69181389d44371ba36874f6510f7b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ffe91a1-e698-4070-a678-185ccc059064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ffe91a1-e698-4070-a678-185ccc059064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98231aaf-c989-4fe5-8dc9-e3a4dfb9e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98231aaf-c989-4fe5-8dc9-e3a4dfb9e035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6dbba064-ad63-4463-a2ba-1f669c2f86fc', 'volume_name': 'volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc', 'volume_size': 2, 'source_volid': 'eac0a5d7-d11a-493e-b7aa-40835574bf05', 'source_volstatus': 'available'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111e6d43-26c1-4d10-8e00-f5a58b9c0a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111e6d43-26c1-4d10-8e00-f5a58b9c0a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20d2788-8ca5-4c13-9bf8-b535bb4e7ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:11 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Volume 6dbba064-ad63-4463-a2ba-1f669c2f86fc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc', 'volume_size': 2, 'source_volid': 'eac0a5d7-d11a-493e-b7aa-40835574bf05', 'source_volstatus': 'available'} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:11 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] 8dcf692b-f75b-4a29-963c-f59ebe841cf3 was qcow2, converting to raw {{(pid=83352) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:11 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 Feb 26 20:30:11 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:11 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8 1073741824" returned: 0 in 0.940s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:11 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8 Feb 26 20:30:11 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:11 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8" returned: 0 in 0.558s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.874s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1392610006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8f5f18-db1c-4f58-83b0-58690d8f407f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b992bb422f145baa954d36ebf0e5e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:10Z,use_quota=True,user_id='f372ea53b4024ffb9f0dfdf9f32561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Creating volume dd8f5f18-db1c-4f58-83b0-58690d8f407f {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:11 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d822d32-2147-47ba-a7df-ded9a734523c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78d382e-fedd-48f7-8d9c-31b36d44f952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:11 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f 1073741824 Feb 26 20:30:11 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:11 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Volume volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8 (d0176c0e-259d-432c-bb14-8d9feab3e8b8): created successfully Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78d382e-fedd-48f7-8d9c-31b36d44f952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Flow 'volume_create_manager' (e10f84a1-5aae-46ce-a198-1b206ae670fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:11 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a6f4a68b-a58a-4e8f-acf4-09787476d24e tempest-CreateVolumesFromImageTest-1397963980 None] Created volume successfully. Feb 26 20:30:12 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35" returned: 0 in 1.167s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:12 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3__9nfc5xbdevstack@QuobyteHD, size 112.00 MB, duration 1.17 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:30:12 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Converted 112.00 MB image at 95.89 MB/s Feb 26 20:30:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:12 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 1G Feb 26 20:30:12 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:12 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f 1073741824" returned: 0 in 0.725s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:12 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f Feb 26 20:30:12 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:12 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 1G" returned: 0 in 0.534s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:12 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[177ac13c-9ccf-440b-88e4-a0cc62569bdf]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:13 devstack sudo[88633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 Feb 26 20:30:13 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:13 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f" returned: 0 in 0.507s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.993s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-326593626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b3c3f2-1f42-486f-b49c-c944d7195c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b992bb422f145baa954d36ebf0e5e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:10Z,use_quota=True,user_id='f372ea53b4024ffb9f0dfdf9f32561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Creating volume c7b3c3f2-1f42-486f-b49c-c944d7195c67 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:13 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6559218-6aed-4d08-97d4-35178aacd6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9044a91d-bf58-4d6e-bea3-945ae252e737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:13 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67 1073741824 Feb 26 20:30:13 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:13 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Volume volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f (dd8f5f18-db1c-4f58-83b0-58690d8f407f): created successfully Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9044a91d-bf58-4d6e-bea3-945ae252e737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Flow 'volume_create_manager' (72ede161-acd2-4bc9-94f8-d798adccf259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:13 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c49024f2-d7e2-43f9-a711-67b78047b089 tempest-CreateVolumesFromImageTest-1397963980 None] Created volume successfully. Feb 26 20:30:13 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35" returned: 0 in 0.547s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:13 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 Feb 26 20:30:13 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:13 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67 1073741824" returned: 0 in 0.534s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:13 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67 Feb 26 20:30:13 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:14 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35" returned: 1 in 0.606s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.volume_utils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Downloaded image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}])) to volume ef569b49-d9f1-4b8f-8d70-9e30494fab35 successfully. {{(pid=83352) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Temporary image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 for user fa008fec1dc24751adc526cc0b27c435 is deleted. {{(pid=83352) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.volume_utils [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Marking volume ef569b49-d9f1-4b8f-8d70-9e30494fab35 as bootable. {{(pid=83352) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Copying metadata from image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 to ef569b49-d9f1-4b8f-8d70-9e30494fab35. {{(pid=83352) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Creating volume glance metadata for volume ef569b49-d9f1-4b8f-8d70-9e30494fab35 backed by image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83352) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 26 20:30:14 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f6a3bc-e451-460a-9686-1105685ba297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35', 'volume_size': 1, 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9cc93d85d98d418bb1b53f2c8bbda0ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'created_at': datetime.datetime(2026, 2, 26, 19, 20, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 19, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae35061a-5d93-4056-84e7-70eb4935a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67" returned: 0 in 0.499s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.679s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1796214137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465e1cef-001c-4d94-be7a-0712df6062f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b992bb422f145baa954d36ebf0e5e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:10Z,use_quota=True,user_id='f372ea53b4024ffb9f0dfdf9f32561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Creating volume 465e1cef-001c-4d94-be7a-0712df6062f0 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:14 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-465e1cef-001c-4d94-be7a-0712df6062f0 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:14 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Volume volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 (ef569b49-d9f1-4b8f-8d70-9e30494fab35): created successfully Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae35061a-5d93-4056-84e7-70eb4935a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:14 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-465e1cef-001c-4d94-be7a-0712df6062f0 1073741824 Feb 26 20:30:14 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Flow 'volume_create_manager' (9c3ffa56-2719-422b-a161-2425cac033fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77914da7-7e8b-465d-ae34-14052a7a2df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72dc9616-46e3-4c48-b2b0-67a48337f7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:14 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-eeb14937-fb61-45e9-9032-159f7a723e26 tempest-VolumesExtendTest-1736868327 None] Created volume successfully. Feb 26 20:30:14 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Volume volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67 (c7b3c3f2-1f42-486f-b49c-c944d7195c67): created successfully Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72dc9616-46e3-4c48-b2b0-67a48337f7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Flow 'volume_create_manager' (8514557d-9d55-4f36-befc-a2a214cd1324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:14 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-9eb6c7cb-1073-4ce4-8b59-5fa47fc9d49e tempest-CreateVolumesFromImageTest-1397963980 None] Created volume successfully. Feb 26 20:30:14 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-465e1cef-001c-4d94-be7a-0712df6062f0 1073741824" returned: 0 in 0.565s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-465e1cef-001c-4d94-be7a-0712df6062f0 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:14 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-465e1cef-001c-4d94-be7a-0712df6062f0 Feb 26 20:30:14 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5810ba1b-c833-436c-96ec-338e0f76030e tempest-VolumesExtendTest-1736868327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:15 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-465e1cef-001c-4d94-be7a-0712df6062f0" returned: 0 in 0.546s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.495s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1613641344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c78207a8-e22b-4ddd-93d7-cbbcb1e05a91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b992bb422f145baa954d36ebf0e5e59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:11Z,use_quota=True,user_id='f372ea53b4024ffb9f0dfdf9f32561a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Creating volume c78207a8-e22b-4ddd-93d7-cbbcb1e05a91 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:15 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cf950c-47a1-4d4b-b1cf-6e435f1c910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-465e1cef-001c-4d94-be7a-0712df6062f0', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309a5204-690e-49cd-be01-89fa9effa9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:15 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91 1073741824 Feb 26 20:30:15 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:15 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Volume volume-465e1cef-001c-4d94-be7a-0712df6062f0 (465e1cef-001c-4d94-be7a-0712df6062f0): created successfully Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309a5204-690e-49cd-be01-89fa9effa9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Flow 'volume_create_manager' (af57d348-d0d9-4947-8fb3-16d546dd1c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:15 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3f0ae5fb-c2a2-4924-90d3-8d52f0868145 tempest-CreateVolumesFromImageTest-1397963980 None] Created volume successfully. Feb 26 20:30:15 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91 1073741824" returned: 0 in 0.539s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:15 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91 Feb 26 20:30:15 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:16 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91" returned: 0 in 0.533s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.426s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:16 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Cloning volume eac0a5d7-d11a-493e-b7aa-40835574bf05 to volume 6dbba064-ad63-4463-a2ba-1f669c2f86fc Feb 26 20:30:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57a95a6-e24f-48f8-a980-958ba0c056a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4eb7983-e7f0-45e1-9cd0-912d3e5c0282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Creating offline snapshot 5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b of volume eac0a5d7-d11a-493e-b7aa-40835574bf05 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:30:16 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Volume volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91 (c78207a8-e22b-4ddd-93d7-cbbcb1e05a91): created successfully Feb 26 20:30:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4eb7983-e7f0-45e1-9cd0-912d3e5c0282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:16 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Flow 'volume_create_manager' (87d9d819-4cc7-4167-9547-9ad06f1234d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:16 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[52314ad0-ab4f-4369-bd23-c779af35398c]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:16 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-ed8b3402-7869-44b0-844a-f1f688cca300 tempest-CreateVolumesFromImageTest-1397963980 None] Created volume successfully. Feb 26 20:30:16 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 Feb 26 20:30:16 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:17 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05" returned: 0 in 0.626s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:17 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b 1G Feb 26 20:30:17 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "cinder-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "cinder-quobyte-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-quobyte-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91" acquired by "delete_volume" :: waited 0.024s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:17 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d4df3a-5817-4eb4-bb17-fa488305becf]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:17 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91 Feb 26 20:30:17 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:17 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b 1G" returned: 0 in 0.601s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:17 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b Feb 26 20:30:17 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:18 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91" returned: 0 in 0.650s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:18 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91 Feb 26 20:30:18 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:18 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b" returned: 0 in 0.494s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:18 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b is being set with open permissions: ugo+rw Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:18 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b Feb 26 20:30:18 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:18 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b" returned: 0 in 0.481s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:18 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91" returned: 0 in 0.585s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:18 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.info Feb 26 20:30:18 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-quobyte-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91" released by "delete_volume" :: held 1.282s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Created reservations ['26408b15-8c53-4fdc-8396-b2272dd78d8c', '30c0a719-5966-4223-b329-631f76b07ef4', '139dffe9-c5e1-420e-a331-17d8a9001ca8', 'a8ee9609-2dca-48ce-a76f-b4da156613a6'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:18 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:18 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:19 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.info" returned: 0 in 0.657s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:19 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.info is being set with open permissions: ugo+rw Feb 26 20:30:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:19 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.info Feb 26 20:30:19 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:19 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.624s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:19 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:19 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Deleted volume successfully. Feb 26 20:30:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-27192b0c-bd29-448f-b462-abe6fe32d02b tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-c78207a8-e22b-4ddd-93d7-cbbcb1e05a91-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "cinder-465e1cef-001c-4d94-be7a-0712df6062f0-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-465e1cef-001c-4d94-be7a-0712df6062f0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "cinder-quobyte-465e1cef-001c-4d94-be7a-0712df6062f0" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-quobyte-465e1cef-001c-4d94-be7a-0712df6062f0" acquired by "delete_volume" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:19 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d758d-7479-4e3f-88db-b201649219b3]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-465e1cef-001c-4d94-be7a-0712df6062f0 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:19 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-465e1cef-001c-4d94-be7a-0712df6062f0 Feb 26 20:30:19 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:20 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.info" returned: 0 in 0.640s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Acquiring lock "cinder-quobyte-6dbba064-ad63-4463-a2ba-1f669c2f86fc" by "_copy_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Lock "cinder-quobyte-6dbba064-ad63-4463-a2ba-1f669c2f86fc" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] snapshot: 5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b, volume: 6dbba064-ad63-4463-a2ba-1f669c2f86fc, {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f1f931-b4d0-4e2e-a4a9-2c8499613303]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:20 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b Feb 26 20:30:20 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:20 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-465e1cef-001c-4d94-be7a-0712df6062f0" returned: 0 in 0.628s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-465e1cef-001c-4d94-be7a-0712df6062f0 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:20 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-465e1cef-001c-4d94-be7a-0712df6062f0 Feb 26 20:30:20 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:20 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b" returned: 0 in 0.633s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eac0a5d7-d11a-493e-b7aa-40835574bf05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Creating direct copy from snapshot {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e613ce-eb02-4332-888b-78f7d23c46c3]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:20 devstack sudo[88747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 Feb 26 20:30:20 devstack sudo[88747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:20 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-465e1cef-001c-4d94-be7a-0712df6062f0" returned: 0 in 0.495s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:20 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-quobyte-465e1cef-001c-4d94-be7a-0712df6062f0" released by "delete_volume" :: held 1.183s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Created reservations ['6a34c34c-a334-4978-a2b8-2d05b537d2d1', 'af968bf3-4e7f-49e6-9c93-0774b29005b4', '4cbb6949-2caf-445b-bde3-4529b68904d9', 'f5dfdc48-d48f-4673-bb99-0d151a7709ba'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:21 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:21 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:21 devstack sudo[88747]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05" returned: 0 in 0.548s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG cinder.utils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Path /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc not found in is_blk_device check {{(pid=83352) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:21 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc Feb 26 20:30:21 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:21 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.465s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:21 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Deleted volume successfully. Feb 26 20:30:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0ea274eb-2bf4-4703-b81a-7f314009425c tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-465e1cef-001c-4d94-be7a-0712df6062f0-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "cinder-c7b3c3f2-1f42-486f-b49c-c944d7195c67-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-c7b3c3f2-1f42-486f-b49c-c944d7195c67-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "cinder-quobyte-c7b3c3f2-1f42-486f-b49c-c944d7195c67" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-quobyte-c7b3c3f2-1f42-486f-b49c-c944d7195c67" acquired by "delete_volume" :: waited 0.027s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:22 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9888620-25f6-4ea9-928b-fdc86798a9db]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:22 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67 Feb 26 20:30:22 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:23 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67" returned: 0 in 1.501s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:24 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67 Feb 26 20:30:24 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG oslo_service.periodic_task [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83352) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:24 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:24 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:24 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc" returned: 0 in 2.948s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e842fe3-e3dd-463e-8027-3638e9ac700b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:24 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 Feb 26 20:30:24 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:24 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c7b3c3f2-1f42-486f-b49c-c944d7195c67" returned: 0 in 0.941s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-quobyte-c7b3c3f2-1f42-486f-b49c-c944d7195c67" released by "delete_volume" :: held 2.509s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:24 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.824s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:24 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Created reservations ['61779c65-f340-46d2-aa5f-e970d6c8cd93', '07f9e6c3-239d-4622-b8b1-fa1ceffdc3dd', '27a107ef-0dec-4693-8849-8a8880c24df7', '2369d9f8-6643-45c3-a3ee-49a498b00625'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:25 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:25 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:25 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05" returned: 0 in 1.090s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05, size 1024.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:30:25 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Converted 1024.00 MB image at 347.19 MB/s Feb 26 20:30:25 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc is being set with open permissions: ugo+rw Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:25 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc Feb 26 20:30:25 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:25 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.511s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:25 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Deleted volume successfully. Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e5b530bf-93b9-478a-ae4b-9d2082b4d3c5 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-c7b3c3f2-1f42-486f-b49c-c944d7195c67-delete_volume" released by "delete_volume" :: held 3.443s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "cinder-dd8f5f18-db1c-4f58-83b0-58690d8f407f-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-dd8f5f18-db1c-4f58-83b0-58690d8f407f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "cinder-quobyte-dd8f5f18-db1c-4f58-83b0-58690d8f407f" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-quobyte-dd8f5f18-db1c-4f58-83b0-58690d8f407f" acquired by "delete_volume" :: waited 0.024s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[967b9f97-1e9d-438e-9456-200ee6651fda]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:26 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f Feb 26 20:30:26 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:26 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc" returned: 0 in 0.796s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Lock "cinder-quobyte-6dbba064-ad63-4463-a2ba-1f669c2f86fc" released by "_copy_volume_from_snapshot" :: held 6.086s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Acquiring lock "cinder-quobyte-5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Lock "cinder-quobyte-5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Deleting offline snapshot 5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b of volume eac0a5d7-d11a-493e-b7aa-40835574bf05 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:30:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] snapshot_file for this snap is: volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:30:26 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9562ea-0fdc-4967-b621-40bbe52df420]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:26 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b Feb 26 20:30:26 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:26 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f" returned: 0 in 0.819s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:26 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f Feb 26 20:30:26 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:27 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b" returned: 0 in 0.805s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eac0a5d7-d11a-493e-b7aa-40835574bf05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[098ab142-ebbf-49dd-a810-f38d32a30ffa]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:27 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 Feb 26 20:30:27 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:27 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dd8f5f18-db1c-4f58-83b0-58690d8f407f" returned: 0 in 0.549s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-quobyte-dd8f5f18-db1c-4f58-83b0-58690d8f407f" released by "delete_volume" :: held 1.407s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Created reservations ['845a76d8-11b4-41fe-8711-68432dfc77a1', 'ebc617ef-d82f-4aff-945d-243f801c433f', '95ca0bc6-fee3-495d-bf0b-a3247d71eb81', '3f83ef3f-bb38-41bb-b0ac-a78f8d7bda4c'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:27 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:27 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:27 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05" returned: 0 in 0.586s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:27 devstack sudo[88826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b Feb 26 20:30:27 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:27 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.473s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:27 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Deleted volume successfully. Feb 26 20:30:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b7f21de8-4d70-492e-a427-59b0950c08b6 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-dd8f5f18-db1c-4f58-83b0-58690d8f407f-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "cinder-d0176c0e-259d-432c-bb14-8d9feab3e8b8-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-d0176c0e-259d-432c-bb14-8d9feab3e8b8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "cinder-quobyte-d0176c0e-259d-432c-bb14-8d9feab3e8b8" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-quobyte-d0176c0e-259d-432c-bb14-8d9feab3e8b8" acquired by "delete_volume" :: waited 0.018s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:28 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b" returned: 0 in 0.550s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[661bfa82-4d93-41b6-a050-6842ed4787f6]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:28 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b Feb 26 20:30:28 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:28 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8 Feb 26 20:30:28 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:28 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05.5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b" returned: 0 in 0.497s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Lock "cinder-quobyte-5e2e8db2-9ab9-4010-90b5-c9d8ce45be3b" released by "_delete_snapshot" :: held 2.497s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.275s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:28 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5810ba1b-c833-436c-96ec-338e0f76030e tempest-VolumesExtendTest-1736868327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 13.671s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8" returned: 0 in 0.571s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e20d2788-8ca5-4c13-9bf8-b535bb4e7ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc', 'volume_size': 2, 'source_volid': 'eac0a5d7-d11a-493e-b7aa-40835574bf05', 'source_volstatus': 'available'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4569fe-b4c4-4e4a-a6f3-addcc0f0a1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:28 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8 Feb 26 20:30:28 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:28 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Volume volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc (6dbba064-ad63-4463-a2ba-1f669c2f86fc): created successfully Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4569fe-b4c4-4e4a-a6f3-addcc0f0a1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Flow 'volume_create_manager' (4ce653ee-05c8-4708-b45c-1f64249b0067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73952e2-b5bd-4293-9574-3d66df1bbe56]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5810ba1b-c833-436c-96ec-338e0f76030e tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:28 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0a2327b2-ef6a-4b40-917c-35ab7644ecbf tempest-VolumesCloneTest-328567630 None] Created volume successfully. Feb 26 20:30:28 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 Feb 26 20:30:28 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:29 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d0176c0e-259d-432c-bb14-8d9feab3e8b8" returned: 0 in 0.596s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-quobyte-d0176c0e-259d-432c-bb14-8d9feab3e8b8" released by "delete_volume" :: held 1.248s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:29 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5810ba1b-c833-436c-96ec-338e0f76030e tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35" returned: 0 in 0.616s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5810ba1b-c833-436c-96ec-338e0f76030e tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Created reservations ['50ab27da-15ce-41e6-946d-7cc999237df0', '6e2caa9b-c008-4f10-aae6-af00ea9c11d1', 'da6bcad5-3874-482f-814d-f6b5a52010d7', '0b9f1a79-2501-48de-8caf-4793049d1acf'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:29 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 Feb 26 20:30:29 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:29 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:29 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Acquiring lock "cinder-6dbba064-ad63-4463-a2ba-1f669c2f86fc-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Lock "cinder-6dbba064-ad63-4463-a2ba-1f669c2f86fc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Acquiring lock "cinder-quobyte-6dbba064-ad63-4463-a2ba-1f669c2f86fc" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Lock "cinder-quobyte-6dbba064-ad63-4463-a2ba-1f669c2f86fc" acquired by "delete_volume" :: waited 0.018s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[61552fd6-9866-4c69-875b-3ddfae9e9bc9]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:29 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc Feb 26 20:30:29 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:30 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5810ba1b-c833-436c-96ec-338e0f76030e tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35" returned: 1 in 0.615s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5810ba1b-c833-436c-96ec-338e0f76030e tempest-VolumesExtendTest-1736868327 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5810ba1b-c833-436c-96ec-338e0f76030e tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 2G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5810ba1b-c833-436c-96ec-338e0f76030e tempest-VolumesExtendTest-1736868327 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 2G" returned: 0 in 0.064s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5810ba1b-c833-436c-96ec-338e0f76030e tempest-VolumesExtendTest-1736868327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.353s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:30 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-5810ba1b-c833-436c-96ec-338e0f76030e tempest-VolumesExtendTest-1736868327 None] Extend volume completed successfully. Feb 26 20:30:30 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.638s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:30 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Deleted volume successfully. Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0fa9d5eb-e4ab-40ef-9ab5-4b4db0685b87 tempest-CreateVolumesFromImageTest-1397963980 None] Lock "cinder-d0176c0e-259d-432c-bb14-8d9feab3e8b8-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:30 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc" returned: 0 in 0.744s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Acquiring lock "cinder-ef569b49-d9f1-4b8f-8d70-9e30494fab35-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:30 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc Feb 26 20:30:30 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-ef569b49-d9f1-4b8f-8d70-9e30494fab35-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Acquiring lock "cinder-quobyte-ef569b49-d9f1-4b8f-8d70-9e30494fab35" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-quobyte-ef569b49-d9f1-4b8f-8d70-9e30494fab35" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8fd235-e207-4ee7-84ef-6778d68022db]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:30 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 Feb 26 20:30:30 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:31 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-6dbba064-ad63-4463-a2ba-1f669c2f86fc" returned: 0 in 0.571s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Lock "cinder-quobyte-6dbba064-ad63-4463-a2ba-1f669c2f86fc" released by "delete_volume" :: held 1.352s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Created reservations ['2ce46edd-675d-4976-a258-8e8812439f1e', 'f9e452fa-fa7a-4058-bba1-d61fed6dd09e', '587c87fa-e9bf-4ca9-9e30-a415acc3c75b', 'dabca58d-4c47-457f-9241-6ef65571844b'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:31 devstack sudo[88872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:31 devstack sudo[88872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:31 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35" returned: 0 in 0.805s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:31 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 Feb 26 20:30:31 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:31 devstack sudo[88872]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.641s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:31 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Deleted volume successfully. Feb 26 20:30:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d501b491-e4c1-478b-a3ea-70ed9d852165 tempest-VolumesCloneTest-328567630 None] Lock "cinder-6dbba064-ad63-4463-a2ba-1f669c2f86fc-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Acquiring lock "cinder-eac0a5d7-d11a-493e-b7aa-40835574bf05-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Lock "cinder-eac0a5d7-d11a-493e-b7aa-40835574bf05-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Acquiring lock "cinder-quobyte-eac0a5d7-d11a-493e-b7aa-40835574bf05" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Lock "cinder-quobyte-eac0a5d7-d11a-493e-b7aa-40835574bf05" acquired by "delete_volume" :: waited 0.023s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:32 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[411e688a-8705-4610-91b2-98dc68b45961]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:32 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 Feb 26 20:30:32 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:32 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35" returned: 1 in 1.179s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:30:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:32 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35 Feb 26 20:30:32 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:33 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05" returned: 0 in 1.343s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:33 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05 Feb 26 20:30:33 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:33 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ef569b49-d9f1-4b8f-8d70-9e30494fab35" returned: 0 in 1.148s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-quobyte-ef569b49-d9f1-4b8f-8d70-9e30494fab35" released by "delete_volume" :: held 3.202s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:33 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Created reservations ['dbcd4468-3412-4630-9667-d471c99306f1', 'd764acd7-642a-478e-a35f-e68acc5b8f50', '35ad7f60-3920-459a-a8e4-0166602a3092', '8a6d0578-8b67-49a4-80ad-645a112560ff'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:34 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:34 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Flow 'volume_create_manager' (34c9ca4b-98cd-4e00-8e0d-abea719ce5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d07377-ddd1-4752-a226-479a72403b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d07377-ddd1-4752-a226-479a72403b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062706269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88248245-54f1-4f53-b651-d157a200cc1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d149c6845f0949b284b530f54ca29bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:34Z,use_quota=True,user_id='0ee7abd8407a49f1a24b1c8b81ced61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a064ad2c-3525-4758-9763-98ebac30c4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a064ad2c-3525-4758-9763-98ebac30c4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a3dc7e-641a-47d7-bd43-9c41b593fe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a3dc7e-641a-47d7-bd43-9c41b593fe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88248245-54f1-4f53-b651-d157a200cc1b', 'volume_name': 'volume-88248245-54f1-4f53-b651-d157a200cc1b', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d03c57b-9df3-4bfc-8ef9-303ea5b81c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d03c57b-9df3-4bfc-8ef9-303ea5b81c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fef410b-3c52-412b-89ae-0d27da8e36ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:34 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume 88248245-54f1-4f53-b651-d157a200cc1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88248245-54f1-4f53-b651-d157a200cc1b', 'volume_size': 1} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1062706269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88248245-54f1-4f53-b651-d157a200cc1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d149c6845f0949b284b530f54ca29bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:34Z,use_quota=True,user_id='0ee7abd8407a49f1a24b1c8b81ced61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Creating volume 88248245-54f1-4f53-b651-d157a200cc1b {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:34 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:34 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b 1073741824 Feb 26 20:30:34 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:34 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-eac0a5d7-d11a-493e-b7aa-40835574bf05" returned: 0 in 1.254s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Lock "cinder-quobyte-eac0a5d7-d11a-493e-b7aa-40835574bf05" released by "delete_volume" :: held 2.676s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Created reservations ['e2cf6fc7-5da1-47f1-9e18-039105ec5ec9', '0ab74bed-85ed-4f64-973e-30c862280cb4', 'eb26b4ec-fe5f-4957-84f7-9635918d7df1', '6e667d06-26ef-4086-af97-5008ceb048a6'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:35 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:35 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:35 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 1.262s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:35 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Deleted volume successfully. Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0b9774fe-75a3-4dda-9ac6-b5098c827549 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-ef569b49-d9f1-4b8f-8d70-9e30494fab35-delete_volume" released by "delete_volume" :: held 4.869s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Flow 'volume_create_manager' (66d5f567-9921-4971-88c5-8ebecba7861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:35 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfa7962-ee82-4e2b-98d2-8b8f4a3e654b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b 1073741824" returned: 0 in 1.282s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cfa7962-ee82-4e2b-98d2-8b8f4a3e654b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1236262906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7639c7cc-726e-4660-9b42-fd3b68b2cdce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e627ef17ca48fe9212b1095d06367b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:36Z,use_quota=True,user_id='fa008fec1dc24751adc526cc0b27c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2104466-f2c8-44ec-bc27-83f7888387e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2104466-f2c8-44ec-bc27-83f7888387e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6bbedd-306c-42bd-9b5f-49ca43d7a0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf6bbedd-306c-42bd-9b5f-49ca43d7a0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7639c7cc-726e-4660-9b42-fd3b68b2cdce', 'volume_name': 'volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389448a3-3e01-4489-a89a-805e820db8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389448a3-3e01-4489-a89a-805e820db8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b13af5-43d9-406b-958f-54c890d4a652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:35 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Volume 7639c7cc-726e-4660-9b42-fd3b68b2cdce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce', 'volume_size': 1} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:35 devstack sudo[88942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b Feb 26 20:30:35 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:36 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.892s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:36 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Deleted volume successfully. Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-849eac50-394f-4558-a654-c629056e8db0 tempest-VolumesCloneTest-328567630 None] Lock "cinder-eac0a5d7-d11a-493e-b7aa-40835574bf05-delete_volume" released by "delete_volume" :: held 4.015s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:36 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b" returned: 0 in 0.829s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] <== create_volume: return (2279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1236262906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7639c7cc-726e-4660-9b42-fd3b68b2cdce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e627ef17ca48fe9212b1095d06367b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:36Z,use_quota=True,user_id='fa008fec1dc24751adc526cc0b27c435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Creating volume 7639c7cc-726e-4660-9b42-fd3b68b2cdce {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:36 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fef410b-3c52-412b-89ae-0d27da8e36ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88248245-54f1-4f53-b651-d157a200cc1b', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:36 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce 1073741824 Feb 26 20:30:36 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75962a8a-c857-4e9b-af2f-0503ad7ef9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:36 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume volume-88248245-54f1-4f53-b651-d157a200cc1b (88248245-54f1-4f53-b651-d157a200cc1b): created successfully Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75962a8a-c857-4e9b-af2f-0503ad7ef9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Flow 'volume_create_manager' (34c9ca4b-98cd-4e00-8e0d-abea719ce5ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:36 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-26cf7a5a-f8cd-441f-88ff-a46d10098abe tempest-CreateVolumesFromSnapshotTest-752568261 None] Created volume successfully. Feb 26 20:30:37 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce 1073741824" returned: 0 in 0.698s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:37 devstack sudo[88972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce Feb 26 20:30:37 devstack sudo[88972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:38 devstack sudo[88972]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce" returned: 0 in 0.700s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.317s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b13af5-43d9-406b-958f-54c890d4a652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5444f41-9726-476c-a346-45e3bcc8b45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] Creating offline snapshot 9c268154-4c66-4d15-8d39-077869d4880b of volume 88248245-54f1-4f53-b651-d157a200cc1b {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:30:38 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Volume volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce (7639c7cc-726e-4660-9b42-fd3b68b2cdce): created successfully Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5444f41-9726-476c-a346-45e3bcc8b45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Flow 'volume_create_manager' (66d5f567-9921-4971-88c5-8ebecba7861c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[2827adfc-14e6-4de6-8165-8650e861366e]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:38 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-8216b928-4198-4dd3-b498-629c95b01e1c tempest-VolumesExtendTest-1736868327 None] Created volume successfully. Feb 26 20:30:38 devstack sudo[88976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b Feb 26 20:30:38 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Flow 'volume_create_manager' (8895dcbb-a96c-489f-b615-577b89e439d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af6e6ce-4dc7-4123-aa56-8012f3db454d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af6e6ce-4dc7-4123-aa56-8012f3db454d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-916770860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4dc8b4-b2f3-4a11-858e-804ec159b5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7304f4b2b9984a8d8c6ee17b2b0c0050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:38Z,use_quota=True,user_id='e9425248fd394e6584952ad1cec7294b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0835086b-a171-4b21-b51b-72c8671c5956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0835086b-a171-4b21-b51b-72c8671c5956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fdc682-6ecd-4a43-8a39-2a8d007bcb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70fdc682-6ecd-4a43-8a39-2a8d007bcb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd4dc8b4-b2f3-4a11-858e-804ec159b5f5', 'volume_name': 'volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5', 'volume_size': 2}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e65f29-5176-43a4-8320-9075101fd2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e65f29-5176-43a4-8320-9075101fd2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa6b8a5-ed1e-410e-9882-c0226e9be24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:38 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Volume bd4dc8b4-b2f3-4a11-858e-804ec159b5f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5', 'volume_size': 2} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:38 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b" returned: 0 in 0.598s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:38 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b 1G Feb 26 20:30:38 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:39 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b 1G" returned: 0 in 0.653s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88248245-54f1-4f53-b651-d157a200cc1b -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:39 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88248245-54f1-4f53-b651-d157a200cc1b -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b Feb 26 20:30:39 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:39 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88248245-54f1-4f53-b651-d157a200cc1b -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b" returned: 0 in 0.496s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:39 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b is being set with open permissions: ugo+rw Feb 26 20:30:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:39 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b Feb 26 20:30:39 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:40 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b" returned: 0 in 0.427s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:40 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.info Feb 26 20:30:40 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:40 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.info" returned: 0 in 0.434s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:40 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.info is being set with open permissions: ugo+rw Feb 26 20:30:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:40 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.info Feb 26 20:30:40 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:41 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.info" returned: 0 in 0.547s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.276s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.962s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-916770860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd4dc8b4-b2f3-4a11-858e-804ec159b5f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7304f4b2b9984a8d8c6ee17b2b0c0050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:38Z,use_quota=True,user_id='e9425248fd394e6584952ad1cec7294b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Creating volume bd4dc8b4-b2f3-4a11-858e-804ec159b5f5 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:41 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5 2147483648 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:41 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5 2147483648 Feb 26 20:30:41 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:41 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1b957a5a-b898-4844-95e1-9b4fa30465fd tempest-CreateVolumesFromSnapshotTest-752568261 None] Create snapshot completed successfully Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Flow 'volume_create_manager' (b403ac62-7a6f-4611-898f-5d94f8becf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38f58ed-a423-4a66-9719-d6995a8c876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e38f58ed-a423-4a66-9719-d6995a8c876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-932799218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa659ec5-e8e8-4322-91e0-feada5929864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b057c30841ce4f5f9082528d7419b792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:42Z,use_quota=True,user_id='25e943ba4d9c4a328befc8aa53886990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370ae1f1-dbb5-4f2a-bdc0-96eb61f4f204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370ae1f1-dbb5-4f2a-bdc0-96eb61f4f204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cd18a2-6ab5-4520-ae12-eec717b7ee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cd18a2-6ab5-4520-ae12-eec717b7ee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa659ec5-e8e8-4322-91e0-feada5929864', 'volume_name': 'volume-aa659ec5-e8e8-4322-91e0-feada5929864', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0e73d7-0779-4d79-a3b9-dda4ea4a728c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0e73d7-0779-4d79-a3b9-dda4ea4a728c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd576e0-aa5f-438c-a0cc-ef43f6b216c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:41 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Volume aa659ec5-e8e8-4322-91e0-feada5929864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa659ec5-e8e8-4322-91e0-feada5929864', 'volume_size': 1} Feb 26 20:30:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:42 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5 2147483648" returned: 0 in 0.710s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:42 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5 Feb 26 20:30:42 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Flow 'volume_create_manager' (012e8c55-6bdb-40ae-bb9a-affc5f51fc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ca2c69-747b-4688-a7db-f26548e169f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ca2c69-747b-4688-a7db-f26548e169f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1387438469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c58c9e-1e19-4fbc-a637-4849e73299be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d149c6845f0949b284b530f54ca29bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:42Z,use_quota=True,user_id='0ee7abd8407a49f1a24b1c8b81ced61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c022f1a7-a7ff-4973-b2f8-e318ede734cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c022f1a7-a7ff-4973-b2f8-e318ede734cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d303494e-fdea-448f-88ee-4df4c418c84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d303494e-fdea-448f-88ee-4df4c418c84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c58c9e-1e19-4fbc-a637-4849e73299be', 'volume_name': 'volume-03c58c9e-1e19-4fbc-a637-4849e73299be', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5426ee82-fc82-4683-8b8f-b87d8171e8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5426ee82-fc82-4683-8b8f-b87d8171e8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3beb6528-fd6a-43ef-861e-16ea3416a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume 03c58c9e-1e19-4fbc-a637-4849e73299be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c58c9e-1e19-4fbc-a637-4849e73299be', 'volume_size': 1} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Flow 'volume_create_manager' (97d7840d-4c47-48d3-bb46-6eb231ed6a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7620deb-3467-4dd2-a1eb-bb28ad71e299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7620deb-3467-4dd2-a1eb-bb28ad71e299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-339419373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf6783c-7f26-4d71-9ef4-f60d79c94cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d149c6845f0949b284b530f54ca29bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:43Z,use_quota=True,user_id='0ee7abd8407a49f1a24b1c8b81ced61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ffc014-0ffb-4499-aae9-bfa7eb08baf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95ffc014-0ffb-4499-aae9-bfa7eb08baf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44eb75d3-9c83-48a5-bae8-733bb7219a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44eb75d3-9c83-48a5-bae8-733bb7219a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bf6783c-7f26-4d71-9ef4-f60d79c94cfa', 'volume_name': 'volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4effb2d4-4fa7-4d3b-b6b4-4615f68b5874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4effb2d4-4fa7-4d3b-b6b4-4615f68b5874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be458ed1-9df6-49b5-bda9-1e99d4a54456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume 2bf6783c-7f26-4d71-9ef4-f60d79c94cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa', 'volume_size': 1} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Flow 'volume_create_manager' (8261fb6a-2627-4139-8554-2e34ca6c7545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6d5698-1352-4dc0-8c7b-5418aa4606bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be6d5698-1352-4dc0-8c7b-5418aa4606bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1243619198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038991f3-b4e3-41f7-aa88-1424bfc3aa5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d149c6845f0949b284b530f54ca29bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:43Z,use_quota=True,user_id='0ee7abd8407a49f1a24b1c8b81ced61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101a3ca7-1302-4e76-ba86-5eacf2497ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (101a3ca7-1302-4e76-ba86-5eacf2497ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b95e2c0-c250-41cc-8a4b-60986c7c9a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b95e2c0-c250-41cc-8a4b-60986c7c9a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038991f3-b4e3-41f7-aa88-1424bfc3aa5c', 'volume_name': 'volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6363e3d5-c9e8-423e-b47c-2bb828fb8eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6363e3d5-c9e8-423e-b47c-2bb828fb8eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d930120-59ad-42d1-b90a-5417cc7fb906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume 038991f3-b4e3-41f7-aa88-1424bfc3aa5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c', 'volume_size': 1} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5" returned: 0 in 0.730s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.857s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] Creating offline snapshot cdbc9a4a-ede6-4fcb-91b5-dc524087daea of volume 7639c7cc-726e-4660-9b42-fd3b68b2cdce {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa6b8a5-ed1e-410e-9882-c0226e9be24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5', 'volume_size': 2}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14835562-9cc2-4da9-8fc1-46c2f9ad081d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[e070fab7-6335-45a8-b31d-f74077e6f850]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:42 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Volume volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5 (bd4dc8b4-b2f3-4a11-858e-804ec159b5f5): created successfully Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14835562-9cc2-4da9-8fc1-46c2f9ad081d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Flow 'volume_create_manager' (8895dcbb-a96c-489f-b615-577b89e439d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:43 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-43bb8401-d90d-4440-8743-fe21a3313038 tempest-VolumesCloneNegativeTest-1290726080 None] Created volume successfully. Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Flow 'volume_create_manager' (b46a3d30-1d9d-404c-95e5-a99fe7c2b873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e64fff-0951-4ca9-a462-0a729273aa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e64fff-0951-4ca9-a462-0a729273aa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1531718959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e719b530-7f42-4c78-a247-9966024a5f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d149c6845f0949b284b530f54ca29bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:43Z,use_quota=True,user_id='0ee7abd8407a49f1a24b1c8b81ced61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:43 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce Feb 26 20:30:43 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afda365-90b6-4471-a582-f8a160a4687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2afda365-90b6-4471-a582-f8a160a4687a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e333d2-7bb9-4dc4-9f7a-ec308a30bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e333d2-7bb9-4dc4-9f7a-ec308a30bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e719b530-7f42-4c78-a247-9966024a5f7d', 'volume_name': 'volume-e719b530-7f42-4c78-a247-9966024a5f7d', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02520427-324b-486a-a3a4-5eeae4889a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02520427-324b-486a-a3a4-5eeae4889a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068d520f-66da-4485-9143-c22706b4d4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:43 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume e719b530-7f42-4c78-a247-9966024a5f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e719b530-7f42-4c78-a247-9966024a5f7d', 'volume_size': 1} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Flow 'volume_create_manager' (3539b49c-64d3-4c8c-a668-1525941556d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecbf756a-22d7-414e-b47d-c60c1bf1fd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecbf756a-22d7-414e-b47d-c60c1bf1fd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1714384158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4744f3d7-1f70-43f8-9352-21828b5a6fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d149c6845f0949b284b530f54ca29bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:43Z,use_quota=True,user_id='0ee7abd8407a49f1a24b1c8b81ced61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308912ff-98e7-46c4-b8e2-3579b0395875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308912ff-98e7-46c4-b8e2-3579b0395875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771c2a4a-a858-40eb-83c9-23878f40a3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771c2a4a-a858-40eb-83c9-23878f40a3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4744f3d7-1f70-43f8-9352-21828b5a6fe1', 'volume_name': 'volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3f1c4c-d836-46bc-a7b5-4d75278a0b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a3f1c4c-d836-46bc-a7b5-4d75278a0b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef8b139-5607-41c9-99fb-f29a49c0e241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:43 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume 4744f3d7-1f70-43f8-9352-21828b5a6fe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1', 'volume_size': 1} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:43 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce" returned: 0 in 0.596s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:43 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea 1G Feb 26 20:30:43 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Acquiring lock "cinder-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Lock "cinder-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=153,cinder:INSERT=52,cinder:UPDATE=206,cinder:DELETE=19 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Acquiring lock "cinder-quobyte-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Lock "cinder-quobyte-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9883f21-67ac-45f6-96d4-6e5dc72af503]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:44 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5 Feb 26 20:30:44 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:44 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea 1G" returned: 0 in 0.591s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:44 devstack sudo[89045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea Feb 26 20:30:44 devstack sudo[89045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:44 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5" returned: 0 in 0.596s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:44 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5 Feb 26 20:30:44 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:44 devstack sudo[89045]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea" returned: 0 in 0.513s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:44 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea is being set with open permissions: ugo+rw Feb 26 20:30:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:44 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea Feb 26 20:30:44 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:45 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5" returned: 0 in 0.447s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Lock "cinder-quobyte-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5" released by "delete_volume" :: held 1.069s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:DELETE=15,cinder:UPDATE=180,cinder:SELECT=144,cinder:INSERT=48 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Created reservations ['ecf2c27e-1d91-43a2-a151-66da02fab2da', 'f9ddf603-b063-4e3e-9b82-1bbb4ac60df2', '4f509f21-c224-4cee-af14-fc8b870e6dab', 'f158676b-8195-4ec7-ac18-7b7719c812bf'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:45 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:45 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea" returned: 0 in 0.491s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:45 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:45 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.info Feb 26 20:30:45 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:45 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.428s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:45 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Deleted volume successfully. Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ac7a1fa6-6241-4a34-912f-7a764f4070e3 tempest-VolumesCloneNegativeTest-1290726080 None] Lock "cinder-bd4dc8b4-b2f3-4a11-858e-804ec159b5f5-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:45 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.info" returned: 0 in 0.455s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:45 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.info is being set with open permissions: ugo+rw Feb 26 20:30:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:45 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.info Feb 26 20:30:45 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:46 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.info" returned: 0 in 0.435s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.165s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.470s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-932799218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa659ec5-e8e8-4322-91e0-feada5929864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b057c30841ce4f5f9082528d7419b792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:42Z,use_quota=True,user_id='25e943ba4d9c4a328befc8aa53886990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Creating volume aa659ec5-e8e8-4322-91e0-feada5929864 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:46 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa659ec5-e8e8-4322-91e0-feada5929864 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:46 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa659ec5-e8e8-4322-91e0-feada5929864 1073741824 Feb 26 20:30:46 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:46 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-314bea29-5d01-4129-82ca-685caab291bd tempest-VolumesExtendTest-1736868327 None] Create snapshot completed successfully Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-cdee444a-065a-4cfd-a8eb-a047a7a35201 tempest-VolumesExtendTest-1736868327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:46 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa659ec5-e8e8-4322-91e0-feada5929864 1073741824" returned: 0 in 0.764s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa659ec5-e8e8-4322-91e0-feada5929864 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:46 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa659ec5-e8e8-4322-91e0-feada5929864 Feb 26 20:30:46 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:47 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa659ec5-e8e8-4322-91e0-feada5929864" returned: 0 in 0.508s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.014s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1387438469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c58c9e-1e19-4fbc-a637-4849e73299be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d149c6845f0949b284b530f54ca29bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:42Z,use_quota=True,user_id='0ee7abd8407a49f1a24b1c8b81ced61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Creating volume 03c58c9e-1e19-4fbc-a637-4849e73299be {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:47 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-03c58c9e-1e19-4fbc-a637-4849e73299be 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:47 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-03c58c9e-1e19-4fbc-a637-4849e73299be 1073741824 Feb 26 20:30:47 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd576e0-aa5f-438c-a0cc-ef43f6b216c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa659ec5-e8e8-4322-91e0-feada5929864', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bcffeb-a9f6-4a38-ae7f-d2b88161195a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:47 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Volume volume-aa659ec5-e8e8-4322-91e0-feada5929864 (aa659ec5-e8e8-4322-91e0-feada5929864): created successfully Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bcffeb-a9f6-4a38-ae7f-d2b88161195a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Flow 'volume_create_manager' (b403ac62-7a6f-4611-898f-5d94f8becf83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:47 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a812405b-c98a-4eda-945b-9cd55d284766 tempest-ServersNegativeTestJSON-549672845 None] Created volume successfully. Feb 26 20:30:48 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-03c58c9e-1e19-4fbc-a637-4849e73299be 1073741824" returned: 0 in 0.703s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-03c58c9e-1e19-4fbc-a637-4849e73299be {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:48 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-03c58c9e-1e19-4fbc-a637-4849e73299be Feb 26 20:30:48 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Flow 'volume_create_manager' (7a7f7ba5-46f0-4031-83e8-b90ae011ac7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d09526-dfb7-484e-ae77-ab3a3c95c5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d09526-dfb7-484e-ae77-ab3a3c95c5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1418515590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bab29f30514e4c96904c2df3830fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:49Z,use_quota=True,user_id='4ed9eb4a213248cb8fe5a0645924d54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d64b6d8-7339-4e30-aaf2-f616db694f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d64b6d8-7339-4e30-aaf2-f616db694f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b74ff0b-3971-4998-b0e4-5983f008a964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b74ff0b-3971-4998-b0e4-5983f008a964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd', 'volume_name': 'volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd', 'volume_size': 2}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f94fdf-1cd1-42a6-829a-a3dd00f24789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f94fdf-1cd1-42a6-829a-a3dd00f24789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a841d9-3ff9-446c-94a6-253cb12c0e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:48 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Volume c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd', 'volume_size': 2} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:48 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-03c58c9e-1e19-4fbc-a637-4849e73299be" returned: 0 in 0.586s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.101s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-339419373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bf6783c-7f26-4d71-9ef4-f60d79c94cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d149c6845f0949b284b530f54ca29bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:43Z,use_quota=True,user_id='0ee7abd8407a49f1a24b1c8b81ced61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Creating volume 2bf6783c-7f26-4d71-9ef4-f60d79c94cfa {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:48 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:48 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa 1073741824 Feb 26 20:30:48 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3beb6528-fd6a-43ef-861e-16ea3416a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c58c9e-1e19-4fbc-a637-4849e73299be', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5d14c3-227a-48dc-951a-dd9cda828db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:48 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume volume-03c58c9e-1e19-4fbc-a637-4849e73299be (03c58c9e-1e19-4fbc-a637-4849e73299be): created successfully Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5d14c3-227a-48dc-951a-dd9cda828db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Flow 'volume_create_manager' (012e8c55-6bdb-40ae-bb9a-affc5f51fc94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:48 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-5cf42021-8db8-4542-9846-9d100e049763 tempest-CreateVolumesFromSnapshotTest-752568261 None] Created volume successfully. Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Flow 'volume_create_manager' (cb0bdf28-b024-4846-bf2a-bf16ef4821bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39102b3b-3946-4707-b20a-d76092d8772c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39102b3b-3946-4707-b20a-d76092d8772c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1687948154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a1cd92-956f-4312-b2cc-1096a7e390db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b057c30841ce4f5f9082528d7419b792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:49Z,use_quota=True,user_id='25e943ba4d9c4a328befc8aa53886990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16bdc00e-fccf-4154-80de-6314ff2df5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16bdc00e-fccf-4154-80de-6314ff2df5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5fa0c9-6200-41a6-adbf-c940caf0b3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c5fa0c9-6200-41a6-adbf-c940caf0b3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a1cd92-956f-4312-b2cc-1096a7e390db', 'volume_name': 'volume-27a1cd92-956f-4312-b2cc-1096a7e390db', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e51ebc-e6ae-43be-a201-5a4797b04669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e51ebc-e6ae-43be-a201-5a4797b04669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbee914-28bd-461a-9490-5cb4c7df2522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:49 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Volume 27a1cd92-956f-4312-b2cc-1096a7e390db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a1cd92-956f-4312-b2cc-1096a7e390db', 'volume_size': 1} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:49 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa 1073741824" returned: 0 in 0.547s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:49 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa Feb 26 20:30:49 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:49 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa" returned: 0 in 0.441s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.840s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1243619198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038991f3-b4e3-41f7-aa88-1424bfc3aa5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d149c6845f0949b284b530f54ca29bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:43Z,use_quota=True,user_id='0ee7abd8407a49f1a24b1c8b81ced61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Creating volume 038991f3-b4e3-41f7-aa88-1424bfc3aa5c {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:49 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be458ed1-9df6-49b5-bda9-1e99d4a54456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0d7de9-ee6b-4ddf-9d55-b046b3a75b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:49 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c 1073741824 Feb 26 20:30:49 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:49 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa (2bf6783c-7f26-4d71-9ef4-f60d79c94cfa): created successfully Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0d7de9-ee6b-4ddf-9d55-b046b3a75b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Flow 'volume_create_manager' (97d7840d-4c47-48d3-bb46-6eb231ed6a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:49 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-2f32ac52-3208-4a80-9474-745b00a5d018 tempest-CreateVolumesFromSnapshotTest-752568261 None] Created volume successfully. Feb 26 20:30:50 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c 1073741824" returned: 0 in 0.520s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:50 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c Feb 26 20:30:50 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:50 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c" returned: 0 in 0.436s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.614s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1531718959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e719b530-7f42-4c78-a247-9966024a5f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d149c6845f0949b284b530f54ca29bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:43Z,use_quota=True,user_id='0ee7abd8407a49f1a24b1c8b81ced61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Creating volume e719b530-7f42-4c78-a247-9966024a5f7d {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:50 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e719b530-7f42-4c78-a247-9966024a5f7d 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d930120-59ad-42d1-b90a-5417cc7fb906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:50 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e719b530-7f42-4c78-a247-9966024a5f7d 1073741824 Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297c2742-c276-4648-bdbc-8b24930987a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:50 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:50 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c (038991f3-b4e3-41f7-aa88-1424bfc3aa5c): created successfully Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (297c2742-c276-4648-bdbc-8b24930987a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Flow 'volume_create_manager' (8261fb6a-2627-4139-8554-2e34ca6c7545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:50 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-20a38aaf-668e-499a-affd-359fb2001d01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Created volume successfully. Feb 26 20:30:51 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e719b530-7f42-4c78-a247-9966024a5f7d 1073741824" returned: 0 in 0.540s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e719b530-7f42-4c78-a247-9966024a5f7d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:51 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e719b530-7f42-4c78-a247-9966024a5f7d Feb 26 20:30:51 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:51 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e719b530-7f42-4c78-a247-9966024a5f7d" returned: 0 in 0.444s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.466s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1714384158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4744f3d7-1f70-43f8-9352-21828b5a6fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d149c6845f0949b284b530f54ca29bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:43Z,use_quota=True,user_id='0ee7abd8407a49f1a24b1c8b81ced61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Creating volume 4744f3d7-1f70-43f8-9352-21828b5a6fe1 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:51 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (068d520f-66da-4485-9143-c22706b4d4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e719b530-7f42-4c78-a247-9966024a5f7d', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:51 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1 1073741824 Feb 26 20:30:51 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864ae3f6-99ac-40ac-8745-f014ade38716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:51 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume volume-e719b530-7f42-4c78-a247-9966024a5f7d (e719b530-7f42-4c78-a247-9966024a5f7d): created successfully Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864ae3f6-99ac-40ac-8745-f014ade38716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Flow 'volume_create_manager' (b46a3d30-1d9d-404c-95e5-a99fe7c2b873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:51 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-fdf0ce83-3bb8-40ae-ad8f-ea615f437968 tempest-CreateVolumesFromSnapshotTest-752568261 None] Created volume successfully. Feb 26 20:30:52 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1 1073741824" returned: 0 in 0.573s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:52 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1 Feb 26 20:30:52 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:52 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1" returned: 0 in 0.424s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-cdee444a-065a-4cfd-a8eb-a047a7a35201 tempest-VolumesExtendTest-1736868327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.362s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:52 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63cfb3a-68d2-4431-bd1a-03a67fd6318f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-cdee444a-065a-4cfd-a8eb-a047a7a35201 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:52 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef8b139-5607-41c9-99fb-f29a49c0e241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:52 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2532eff-5b08-4513-bd1a-ae7bc1e96fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:52 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Volume volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1 (4744f3d7-1f70-43f8-9352-21828b5a6fe1): created successfully Feb 26 20:30:52 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2532eff-5b08-4513-bd1a-ae7bc1e96fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:52 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Flow 'volume_create_manager' (3539b49c-64d3-4c8c-a668-1525941556d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:52 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-00914e70-3bc9-41e8-af4e-b435756f69f0 tempest-CreateVolumesFromSnapshotTest-752568261 None] Created volume successfully. Feb 26 20:30:52 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce Feb 26 20:30:52 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-4744f3d7-1f70-43f8-9352-21828b5a6fe1-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-4744f3d7-1f70-43f8-9352-21828b5a6fe1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-quobyte-4744f3d7-1f70-43f8-9352-21828b5a6fe1" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-4744f3d7-1f70-43f8-9352-21828b5a6fe1" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8424b0a-d834-4787-8313-3dc56008f529]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:53 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1 Feb 26 20:30:53 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:53 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-cdee444a-065a-4cfd-a8eb-a047a7a35201 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce" returned: 0 in 0.524s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-cdee444a-065a-4cfd-a8eb-a047a7a35201 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea 2G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-cdee444a-065a-4cfd-a8eb-a047a7a35201 tempest-VolumesExtendTest-1736868327 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea 2G" returned: 0 in 0.127s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-cdee444a-065a-4cfd-a8eb-a047a7a35201 tempest-VolumesExtendTest-1736868327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.671s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.861s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1418515590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24bab29f30514e4c96904c2df3830fef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:49Z,use_quota=True,user_id='4ed9eb4a213248cb8fe5a0645924d54a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Creating volume c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:53 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd 2147483648 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:53 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd 2147483648 Feb 26 20:30:53 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:53 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-cdee444a-065a-4cfd-a8eb-a047a7a35201 tempest-VolumesExtendTest-1736868327 None] Extend volume completed successfully. Feb 26 20:30:53 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1" returned: 0 in 0.527s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:53 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1 Feb 26 20:30:53 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Acquiring lock "cinder-cdbc9a4a-ede6-4fcb-91b5-dc524087daea-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-cdbc9a4a-ede6-4fcb-91b5-dc524087daea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Acquiring lock "cinder-quobyte-7639c7cc-726e-4660-9b42-fd3b68b2cdce" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:54 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd 2147483648" returned: 0 in 0.593s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-quobyte-7639c7cc-726e-4660-9b42-fd3b68b2cdce" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Acquiring lock "cinder-quobyte-cdbc9a4a-ede6-4fcb-91b5-dc524087daea" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-quobyte-cdbc9a4a-ede6-4fcb-91b5-dc524087daea" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Deleting offline snapshot cdbc9a4a-ede6-4fcb-91b5-dc524087daea of volume 7639c7cc-726e-4660-9b42-fd3b68b2cdce {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] snapshot_file for this snap is: volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59e1dfe-972a-4a8c-8d06-5e5bdc67fe54]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:54 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd Feb 26 20:30:54 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:54 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-4744f3d7-1f70-43f8-9352-21828b5a6fe1" returned: 0 in 0.532s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-4744f3d7-1f70-43f8-9352-21828b5a6fe1" released by "delete_volume" :: held 1.094s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:54 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea Feb 26 20:30:54 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Created reservations ['f1cc1638-0a7d-4977-9122-9285f468bafb', '78b56ea9-738f-43f0-81c8-c007fc49c247', '85270f85-7ccf-49eb-a861-d0f1320215fd', '10bbc357-0b71-42af-bdb3-ed990935e1f8'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:54 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:54 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:54 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd" returned: 0 in 0.478s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.412s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1687948154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a1cd92-956f-4312-b2cc-1096a7e390db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b057c30841ce4f5f9082528d7419b792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:30:49Z,use_quota=True,user_id='25e943ba4d9c4a328befc8aa53886990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Creating volume 27a1cd92-956f-4312-b2cc-1096a7e390db {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:30:54 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27a1cd92-956f-4312-b2cc-1096a7e390db 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a841d9-3ff9-446c-94a6-253cb12c0e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd', 'volume_size': 2}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09cc921-4850-4f78-b6a2-a9d68ca981dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:54 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27a1cd92-956f-4312-b2cc-1096a7e390db 1073741824 Feb 26 20:30:54 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:54 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Volume volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd (c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd): created successfully Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09cc921-4850-4f78-b6a2-a9d68ca981dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Flow 'volume_create_manager' (7a7f7ba5-46f0-4031-83e8-b90ae011ac7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:54 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-5b85fbd2-3477-4158-9432-7907248a928a tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Created volume successfully. Feb 26 20:30:54 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea" returned: 0 in 0.578s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[14db647d-8bd7-42f9-8381-ee7e25695639]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:54 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.455s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:54 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Deleted volume successfully. Feb 26 20:30:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-467b188c-5bab-4391-9cc0-5290ad1bdb01 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-4744f3d7-1f70-43f8-9352-21828b5a6fe1-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:54 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce Feb 26 20:30:54 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-e719b530-7f42-4c78-a247-9966024a5f7d-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-e719b530-7f42-4c78-a247-9966024a5f7d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-quobyte-e719b530-7f42-4c78-a247-9966024a5f7d" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-e719b530-7f42-4c78-a247-9966024a5f7d" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[080a5fd2-3fe8-4f30-9f95-1504219079fc]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e719b530-7f42-4c78-a247-9966024a5f7d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:55 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27a1cd92-956f-4312-b2cc-1096a7e390db 1073741824" returned: 0 in 0.758s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:55 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce" returned: 0 in 0.659s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:55 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea Feb 26 20:30:55 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27a1cd92-956f-4312-b2cc-1096a7e390db {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:55 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27a1cd92-956f-4312-b2cc-1096a7e390db Feb 26 20:30:55 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:55 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e719b530-7f42-4c78-a247-9966024a5f7d Feb 26 20:30:55 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:55 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27a1cd92-956f-4312-b2cc-1096a7e390db" returned: 0 in 0.466s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.847s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Creating offline snapshot d6794245-23cb-4386-928d-9cd36c89d235 of volume c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbee914-28bd-461a-9490-5cb4c7df2522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a1cd92-956f-4312-b2cc-1096a7e390db', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6c82a6-858d-4a72-a7f3-10b3aeb1569c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a9983a-eb0d-46ce-8b31-4ecd22f103ae]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:55 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:56 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e719b530-7f42-4c78-a247-9966024a5f7d" returned: 0 in 0.573s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e719b530-7f42-4c78-a247-9966024a5f7d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:56 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Volume volume-27a1cd92-956f-4312-b2cc-1096a7e390db (27a1cd92-956f-4312-b2cc-1096a7e390db): created successfully Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c6c82a6-858d-4a72-a7f3-10b3aeb1569c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:30:56 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e719b530-7f42-4c78-a247-9966024a5f7d Feb 26 20:30:56 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Flow 'volume_create_manager' (cb0bdf28-b024-4846-bf2a-bf16ef4821bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea" returned: 0 in 0.582s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:56 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0a11a101-1d3d-499c-b47d-ff685ce20949 tempest-ServersNegativeTestJSON-549672845 None] Created volume successfully. Feb 26 20:30:56 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea Feb 26 20:30:56 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:56 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd Feb 26 20:30:56 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:56 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e719b530-7f42-4c78-a247-9966024a5f7d" returned: 0 in 0.426s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-e719b530-7f42-4c78-a247-9966024a5f7d" released by "delete_volume" :: held 1.066s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Created reservations ['35bf1aa2-2bd6-4923-a345-b2f1fb28127f', 'e0b7949e-3ba0-4456-a9e2-756560b0fcb3', 'da532ecf-eeb9-48c5-9ef9-ca343c5c3002', '5d1f64b9-8f8b-47a3-b444-afd0310cf5f5'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:56 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:56 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce.cdbc9a4a-ede6-4fcb-91b5-dc524087daea" returned: 0 in 0.528s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd" returned: 0 in 0.579s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 2G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:56 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:56 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:56 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 2G Feb 26 20:30:56 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-quobyte-cdbc9a4a-ede6-4fcb-91b5-dc524087daea" released by "_delete_snapshot" :: held 2.456s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-quobyte-7639c7cc-726e-4660-9b42-fd3b68b2cdce" released by "delete_snapshot" :: held 2.475s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Created reservations ['1b61a1fb-4ee0-4faf-8dd5-51e828cc354b', '7ab4546f-7076-49f7-bd26-4e14ae0ea3da', 'e424c840-a55b-4b56-8ed9-0785530f6dba', 'ec1883c4-b2c3-44bc-ba80-c51fa0e27318'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:56 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Delete snapshot completed successfully. Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-00408ba6-1378-4e26-9502-c2c59a1292d9 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-cdbc9a4a-ede6-4fcb-91b5-dc524087daea-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Acquiring lock "cinder-27a1cd92-956f-4312-b2cc-1096a7e390db-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Lock "cinder-27a1cd92-956f-4312-b2cc-1096a7e390db-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Acquiring lock "cinder-quobyte-27a1cd92-956f-4312-b2cc-1096a7e390db" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Lock "cinder-quobyte-27a1cd92-956f-4312-b2cc-1096a7e390db" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[440d47b8-ccad-4a5d-a980-102e61eafa68]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27a1cd92-956f-4312-b2cc-1096a7e390db {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:57 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.451s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:57 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Deleted volume successfully. Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-130129f1-d76b-4801-9dd2-bdefcff74813 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-e719b530-7f42-4c78-a247-9966024a5f7d-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:57 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27a1cd92-956f-4312-b2cc-1096a7e390db Feb 26 20:30:57 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:57 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 2G" returned: 0 in 0.730s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:57 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 Feb 26 20:30:57 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Acquiring lock "cinder-7639c7cc-726e-4660-9b42-fd3b68b2cdce-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-7639c7cc-726e-4660-9b42-fd3b68b2cdce-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Acquiring lock "cinder-quobyte-7639c7cc-726e-4660-9b42-fd3b68b2cdce" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-quobyte-7639c7cc-726e-4660-9b42-fd3b68b2cdce" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[eacd0ebb-12b5-4479-a965-72cf4e574841]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-038991f3-b4e3-41f7-aa88-1424bfc3aa5c-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-038991f3-b4e3-41f7-aa88-1424bfc3aa5c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:57 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce Feb 26 20:30:57 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-quobyte-038991f3-b4e3-41f7-aa88-1424bfc3aa5c" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-038991f3-b4e3-41f7-aa88-1424bfc3aa5c" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[91770d19-da40-4d5b-8d61-8b64f6cf5cb9]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:57 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27a1cd92-956f-4312-b2cc-1096a7e390db" returned: 0 in 0.762s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27a1cd92-956f-4312-b2cc-1096a7e390db {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:57 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27a1cd92-956f-4312-b2cc-1096a7e390db Feb 26 20:30:57 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:57 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c Feb 26 20:30:57 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:57 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235" returned: 0 in 0.633s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:57 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 is being set with open permissions: ugo+rw Feb 26 20:30:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:58 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 Feb 26 20:30:58 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:58 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c" returned: 0 in 0.645s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:58 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce" returned: 0 in 0.867s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:58 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c Feb 26 20:30:58 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:58 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce Feb 26 20:30:58 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:58 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-27a1cd92-956f-4312-b2cc-1096a7e390db" returned: 0 in 0.756s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Lock "cinder-quobyte-27a1cd92-956f-4312-b2cc-1096a7e390db" released by "delete_volume" :: held 1.570s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:58 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235" returned: 0 in 0.614s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Created reservations ['6b2fd9b8-f387-4a10-8d96-71b51ba1724b', '46cc7ffc-cd9e-48a6-962b-bc88a0ce6862', '14a694d9-aeca-4c05-8931-c3350d2a9fe3', '6439bf62-ede7-4323-ba41-d4db379e4b89'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:58 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.info Feb 26 20:30:58 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:58 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:58 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:58 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7639c7cc-726e-4660-9b42-fd3b68b2cdce" returned: 0 in 0.564s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:58 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-quobyte-7639c7cc-726e-4660-9b42-fd3b68b2cdce" released by "delete_volume" :: held 1.485s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-038991f3-b4e3-41f7-aa88-1424bfc3aa5c" returned: 0 in 0.591s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-038991f3-b4e3-41f7-aa88-1424bfc3aa5c" released by "delete_volume" :: held 1.265s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Created reservations ['e6b3f639-5502-40af-be7b-e97e1f45a467', '7126630a-30dc-4045-bca0-6ff79c96e477', '4e4560e4-ee95-498d-8155-06fdbb744184', '55ddd5a2-abf1-4d19-a3bd-d79127efc47b'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:58 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Created reservations ['cdf1c0ce-49b6-4d4c-9a65-993dda268e91', '2456d361-90f7-4219-a620-0abedba37378', 'd84032a4-ae03-42f6-88aa-5955e469d458', 'd48c5836-b986-44c7-92f6-97950c267d0d'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:30:59 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.info" returned: 0 in 0.442s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:59 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.info is being set with open permissions: ugo+rw Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:59 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.info Feb 26 20:30:59 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:30:59 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:30:59 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:59 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:30:59 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Acquiring lock "cinder-aa659ec5-e8e8-4322-91e0-feada5929864-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Lock "cinder-aa659ec5-e8e8-4322-91e0-feada5929864-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:59 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.529s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:59 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Deleted volume successfully. Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Acquiring lock "cinder-quobyte-aa659ec5-e8e8-4322-91e0-feada5929864" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a6842d7-eeb6-4ac7-bdae-234eb60bf96c tempest-ServersNegativeTestJSON-549672845 None] Lock "cinder-27a1cd92-956f-4312-b2cc-1096a7e390db-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Lock "cinder-quobyte-aa659ec5-e8e8-4322-91e0-feada5929864" acquired by "delete_volume" :: waited 0.021s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[06746934-1480-4fee-807a-4ed124a49176]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa659ec5-e8e8-4322-91e0-feada5929864 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:59 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa659ec5-e8e8-4322-91e0-feada5929864 Feb 26 20:30:59 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:59 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.info" returned: 0 in 0.464s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.561s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:30:59 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-45b2c126-a796-4387-8a82-7193b87ba4ee tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Create snapshot completed successfully Feb 26 20:30:59 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.574s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:59 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Deleted volume successfully. Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-dd647234-ea30-49e1-8039-3f1d07686106 tempest-VolumesExtendTest-1736868327 None] Lock "cinder-7639c7cc-726e-4660-9b42-fd3b68b2cdce-delete_volume" released by "delete_volume" :: held 2.269s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:59 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.600s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:30:59 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Deleted volume successfully. Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-45213090-7593-4779-abab-da78ea0e373b tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-038991f3-b4e3-41f7-aa88-1424bfc3aa5c-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:30:59 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa659ec5-e8e8-4322-91e0-feada5929864" returned: 0 in 0.532s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa659ec5-e8e8-4322-91e0-feada5929864 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:59 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa659ec5-e8e8-4322-91e0-feada5929864 Feb 26 20:30:59 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-quobyte-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a1ce3e-3dfa-4e26-9e18-7dc890389fd6]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:30:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:30:59 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa Feb 26 20:30:59 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:00 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa659ec5-e8e8-4322-91e0-feada5929864" returned: 0 in 0.526s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Lock "cinder-quobyte-aa659ec5-e8e8-4322-91e0-feada5929864" released by "delete_volume" :: held 1.086s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Created reservations ['9f7aefd2-a228-4f1c-88c2-9187cb359094', '5aa9d9ff-78f2-4531-931b-63cf37bb5c70', '804860de-c31e-4c16-90b7-fa2b832c3230', '59670419-ee86-4d2d-893c-6e9586369d45'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Acquiring lock "cinder-d6794245-23cb-4386-928d-9cd36c89d235-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "cinder-d6794245-23cb-4386-928d-9cd36c89d235-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Acquiring lock "cinder-quobyte-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "cinder-quobyte-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Acquiring lock "cinder-quobyte-d6794245-23cb-4386-928d-9cd36c89d235" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "cinder-quobyte-d6794245-23cb-4386-928d-9cd36c89d235" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Deleting offline snapshot d6794245-23cb-4386-928d-9cd36c89d235 of volume c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] snapshot_file for this snap is: volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b98ec8-5a7a-4020-8e46-55c4a284fe57]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:00 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:00 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:00 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa" returned: 0 in 0.670s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:00 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 Feb 26 20:31:00 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:00 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa Feb 26 20:31:00 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:01 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.642s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:01 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Deleted volume successfully. Feb 26 20:31:01 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa" returned: 0 in 0.571s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-54e87d59-46f0-4bf4-93b5-47ee477d5312 tempest-ServersNegativeTestJSON-549672845 None] Lock "cinder-aa659ec5-e8e8-4322-91e0-feada5929864-delete_volume" released by "delete_volume" :: held 1.994s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa" released by "delete_volume" :: held 1.280s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:01 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235" returned: 0 in 0.702s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5fd7fd-11c9-4726-b1bc-201a0b114705]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Created reservations ['0d593e3e-31af-4eeb-b0ab-6a82d6f8fdf7', 'd6da98b3-2ea5-43a6-96fa-a4b9512917b8', '95fec9f4-9768-4824-8fea-b0bc91f546a0', 'd8f02f80-4a7a-4839-a97d-686764a814c6'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:01 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd Feb 26 20:31:01 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:01 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:01 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:01 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd" returned: 0 in 0.700s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:01 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 Feb 26 20:31:01 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:01 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.666s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:02 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:02 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Deleted volume successfully. Feb 26 20:31:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-52ae9c87-647f-4dfb-94bb-8c8fc2c8284b tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-2bf6783c-7f26-4d71-9ef4-f60d79c94cfa-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-03c58c9e-1e19-4fbc-a637-4849e73299be-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-03c58c9e-1e19-4fbc-a637-4849e73299be-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-quobyte-03c58c9e-1e19-4fbc-a637-4849e73299be" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-03c58c9e-1e19-4fbc-a637-4849e73299be" acquired by "delete_volume" :: waited 0.019s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:02 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1197bc-0821-4d39-844a-917b96127df7]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-03c58c9e-1e19-4fbc-a637-4849e73299be {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:02 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-03c58c9e-1e19-4fbc-a637-4849e73299be Feb 26 20:31:02 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:02 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235" returned: 0 in 0.628s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:02 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235 Feb 26 20:31:02 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:02 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-03c58c9e-1e19-4fbc-a637-4849e73299be" returned: 0 in 0.730s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-03c58c9e-1e19-4fbc-a637-4849e73299be {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:02 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-03c58c9e-1e19-4fbc-a637-4849e73299be Feb 26 20:31:02 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:03 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd.d6794245-23cb-4386-928d-9cd36c89d235" returned: 0 in 0.631s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "cinder-quobyte-d6794245-23cb-4386-928d-9cd36c89d235" released by "_delete_snapshot" :: held 2.797s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "cinder-quobyte-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd" released by "delete_snapshot" :: held 2.816s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Created reservations ['56a37531-0638-42ef-acea-d5a6bf942a58', 'c2131875-9462-4f8d-b414-e5909880669a', 'a3de3804-ab6e-4834-883d-5a9915a4870e', '5309e227-c7cb-45eb-ba1c-e83e33f42436'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:03 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Delete snapshot completed successfully. Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-819088de-b139-4768-a735-ea1ae842dec5 tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "cinder-d6794245-23cb-4386-928d-9cd36c89d235-delete_snapshot" released by "delete_snapshot" :: held 2.941s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:03 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-03c58c9e-1e19-4fbc-a637-4849e73299be" returned: 0 in 0.626s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-03c58c9e-1e19-4fbc-a637-4849e73299be" released by "delete_volume" :: held 1.388s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Created reservations ['4f1cc45e-c83e-4dd4-87c8-736a94543487', 'b84e6115-589f-4981-ad86-0cf6cea79ddf', '996abc84-dfe4-4dbb-a3e8-656461e79b4a', 'e31a5064-ef17-4501-b201-2b9d6d140879'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:03 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:03 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Acquiring lock "cinder-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "cinder-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Acquiring lock "cinder-quobyte-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "cinder-quobyte-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd" acquired by "delete_volume" :: waited 0.023s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9784da-7f91-422b-96b0-cfe8ab73a18e]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:03 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd Feb 26 20:31:03 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:04 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.547s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:04 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Deleted volume successfully. Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ec461aef-2214-4bd6-bd24-26b7278557a2 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-03c58c9e-1e19-4fbc-a637-4849e73299be-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Flow 'volume_create_manager' (649d8f56-f892-4d1a-a5fe-8c4888c1b5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9682f1-5865-4ef4-946c-8d6cd5debbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:04 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f9682f1-5865-4ef4-946c-8d6cd5debbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-31034253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb98edbdc94be1886c92121333a4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:31:04Z,use_quota=True,user_id='a63516120e0744589c8a488c4a25d693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4927d728-1f99-4466-a526-23219b3acd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4927d728-1f99-4466-a526-23219b3acd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a892fcf-1369-461b-8861-5d2d9ef2ba9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a892fcf-1369-461b-8861-5d2d9ef2ba9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c', 'volume_name': 'volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1229ad5e-b729-4682-9a06-1c04970aeaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1229ad5e-b729-4682-9a06-1c04970aeaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33317f6d-7d58-4d35-9ef0-a0a40ddfaf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:04 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Volume 0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c', 'volume_size': 1} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-31034253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbb98edbdc94be1886c92121333a4c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:31:04Z,use_quota=True,user_id='a63516120e0744589c8a488c4a25d693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Creating volume 0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:31:04 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:04 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c 1073741824 Feb 26 20:31:04 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-9c268154-4c66-4d15-8d39-077869d4880b-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd" returned: 0 in 0.693s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-9c268154-4c66-4d15-8d39-077869d4880b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-quobyte-88248245-54f1-4f53-b651-d157a200cc1b" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:04 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd Feb 26 20:31:04 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-88248245-54f1-4f53-b651-d157a200cc1b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-quobyte-9c268154-4c66-4d15-8d39-077869d4880b" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-9c268154-4c66-4d15-8d39-077869d4880b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Deleting offline snapshot 9c268154-4c66-4d15-8d39-077869d4880b of volume 88248245-54f1-4f53-b651-d157a200cc1b {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] snapshot_file for this snap is: volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0415c989-1786-435c-bd55-401064aba198]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:04 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b Feb 26 20:31:04 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:04 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd" returned: 0 in 0.450s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "cinder-quobyte-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd" released by "delete_volume" :: held 1.183s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:04 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Created reservations ['184defa4-894a-4147-bfeb-260c7580ebe4', 'b47f77e1-0f93-4d65-9a25-f4600947f1e9', 'c59de075-9bdd-418d-9f94-77d78954889c', 'ff91914f-5f2d-4e6a-af84-526d5237e7fb'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:05 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:05 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:05 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c 1073741824" returned: 0 in 0.667s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:05 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b" returned: 0 in 0.569s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88248245-54f1-4f53-b651-d157a200cc1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9a1498-c348-407a-9065-5ccc8f8025ad]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:05 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c Feb 26 20:31:05 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:05 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b Feb 26 20:31:05 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:05 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.489s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:05 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Deleted volume successfully. Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-94f0798d-99ab-4683-800c-4c0fda9493aa tempest-VolumesSnapshotNegativeTestJSON-2039760955 None] Lock "cinder-c20ab70e-4f51-4f8a-9ab8-a4e2be55a3fd-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:05 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c" returned: 0 in 0.513s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33317f6d-7d58-4d35-9ef0-a0a40ddfaf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ce5478-6f59-4f0f-a3a2-1aa30855e689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:05 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b" returned: 0 in 0.570s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:05 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Volume volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c (0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c): created successfully Feb 26 20:31:05 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b Feb 26 20:31:05 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53ce5478-6f59-4f0f-a3a2-1aa30855e689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:05 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Flow 'volume_create_manager' (649d8f56-f892-4d1a-a5fe-8c4888c1b5a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:31:05 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-06516fcf-5090-4622-acd8-f0e69173fc19 tempest-VolumesNegativeTest-1630032600 None] Created volume successfully. Feb 26 20:31:06 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b" returned: 0 in 0.644s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:06 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b Feb 26 20:31:06 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:06 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b.9c268154-4c66-4d15-8d39-077869d4880b" returned: 0 in 0.587s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:06 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-9c268154-4c66-4d15-8d39-077869d4880b" released by "_delete_snapshot" :: held 2.473s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:06 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-88248245-54f1-4f53-b651-d157a200cc1b" released by "delete_snapshot" :: held 2.485s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:07 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Created reservations ['fbdcce90-1e32-4fa4-9077-879a58d084ec', 'be39b8a7-9a9f-42c4-a88a-b3c172b95c9f', '7e9c48b5-8696-4c35-8d9d-442427584d2f', 'cb7a05f8-7dfc-453b-8251-ca187862ef6a'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:07 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Delete snapshot completed successfully. Feb 26 20:31:07 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-aaa67eae-de4a-49fa-9d50-e5061f34eda6 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-9c268154-4c66-4d15-8d39-077869d4880b-delete_snapshot" released by "delete_snapshot" :: held 2.636s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:07 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-88248245-54f1-4f53-b651-d157a200cc1b-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:07 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-88248245-54f1-4f53-b651-d157a200cc1b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:07 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "cinder-quobyte-88248245-54f1-4f53-b651-d157a200cc1b" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:07 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-88248245-54f1-4f53-b651-d157a200cc1b" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:07 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b93495-fb33-4d50-b703-53b52b2fdfdb]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:07 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b Feb 26 20:31:07 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:08 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b" returned: 0 in 0.686s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:08 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b Feb 26 20:31:08 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:08 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-88248245-54f1-4f53-b651-d157a200cc1b" returned: 0 in 0.562s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:08 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-quobyte-88248245-54f1-4f53-b651-d157a200cc1b" released by "delete_volume" :: held 1.317s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:08 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Created reservations ['062d8030-6015-45a9-b49b-9b6045a00226', '5dc59a47-ef72-42be-8d2a-2b09f925b961', '96efba46-4bd4-4922-a9a9-0a648112e6b2', '17f33b9c-3437-40d2-8e88-ecf79ab1d8db'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:09 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:09 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:09 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.644s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:09 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:09 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Deleted volume successfully. Feb 26 20:31:09 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0614b450-1b39-4ad0-bfc6-c919446d3b67 tempest-CreateVolumesFromSnapshotTest-752568261 None] Lock "cinder-88248245-54f1-4f53-b651-d157a200cc1b-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Flow 'volume_create_manager' (32ef5b6b-eecd-4c2b-95e9-7c0e17d14796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff2d00b-2481-461c-a2bf-003151e8b099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff2d00b-2481-461c-a2bf-003151e8b099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63528e9f-ce55-42f9-9801-e352f209633c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178f3b16351a4f0cac0ca4b8d707ef3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:31:13Z,use_quota=True,user_id='cd36ebea03ff474d979d60a015e23b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b664bbfd-b119-4545-aba2-e81be9489a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b664bbfd-b119-4545-aba2-e81be9489a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f0b15e-c898-4d10-8ac4-52881d94564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9f0b15e-c898-4d10-8ac4-52881d94564f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63528e9f-ce55-42f9-9801-e352f209633c', 'volume_name': 'volume-63528e9f-ce55-42f9-9801-e352f209633c', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edb56fe-1e97-4c41-9a9a-c29184144e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0edb56fe-1e97-4c41-9a9a-c29184144e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c439c1a-b392-4c2b-86e6-7dfd93e71afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:12 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Volume 63528e9f-ce55-42f9-9801-e352f209633c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63528e9f-ce55-42f9-9801-e352f209633c', 'volume_size': 1} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63528e9f-ce55-42f9-9801-e352f209633c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178f3b16351a4f0cac0ca4b8d707ef3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:31:13Z,use_quota=True,user_id='cd36ebea03ff474d979d60a015e23b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Creating volume 63528e9f-ce55-42f9-9801-e352f209633c {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:31:12 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:31:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-63528e9f-ce55-42f9-9801-e352f209633c 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:12 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-63528e9f-ce55-42f9-9801-e352f209633c 1073741824 Feb 26 20:31:12 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:13 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-63528e9f-ce55-42f9-9801-e352f209633c 1073741824" returned: 0 in 0.954s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-63528e9f-ce55-42f9-9801-e352f209633c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:13 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-63528e9f-ce55-42f9-9801-e352f209633c Feb 26 20:31:13 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:14 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-63528e9f-ce55-42f9-9801-e352f209633c" returned: 0 in 0.542s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:31:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c439c1a-b392-4c2b-86e6-7dfd93e71afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63528e9f-ce55-42f9-9801-e352f209633c', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb36c5f-5181-440a-8c95-960b40a617e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:14 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Volume volume-63528e9f-ce55-42f9-9801-e352f209633c (63528e9f-ce55-42f9-9801-e352f209633c): created successfully Feb 26 20:31:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcb36c5f-5181-440a-8c95-960b40a617e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:14 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Flow 'volume_create_manager' (32ef5b6b-eecd-4c2b-95e9-7c0e17d14796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:31:14 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f4e1e7e7-257d-4296-9d0e-0883d4537480 tempest-CinderUnicodeTest-1798328983 None] Created volume successfully. Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Flow 'volume_create_manager' (73eb11a3-1718-455d-b882-4eeede2cc30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120a0320-9375-4ba1-977a-60c65926419f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120a0320-9375-4ba1-977a-60c65926419f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:31:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-257962584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d18c52-e585-44dd-8c94-101e534cf381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178f3b16351a4f0cac0ca4b8d707ef3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:31:15Z,use_quota=True,user_id='cd36ebea03ff474d979d60a015e23b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cb822b-2bea-4ced-ae58-37a28b92a8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71cb822b-2bea-4ced-ae58-37a28b92a8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1883b676-f9b5-4c93-adf8-b20977006c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1883b676-f9b5-4c93-adf8-b20977006c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57d18c52-e585-44dd-8c94-101e534cf381', 'volume_name': 'volume-57d18c52-e585-44dd-8c94-101e534cf381', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4f80a9-2b85-4db6-a3f0-ef3fd54911e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec4f80a9-2b85-4db6-a3f0-ef3fd54911e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b2dbfd-49f6-421e-9c77-bf2719de31a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:15 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Volume 57d18c52-e585-44dd-8c94-101e534cf381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57d18c52-e585-44dd-8c94-101e534cf381', 'volume_size': 1} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:31:15Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-257962584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57d18c52-e585-44dd-8c94-101e534cf381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178f3b16351a4f0cac0ca4b8d707ef3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:31:15Z,use_quota=True,user_id='cd36ebea03ff474d979d60a015e23b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Creating volume 57d18c52-e585-44dd-8c94-101e534cf381 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:31:15 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:31:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:15 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 1073741824 Feb 26 20:31:15 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:16 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 1073741824" returned: 0 in 0.833s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:16 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 Feb 26 20:31:16 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:17 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381" returned: 0 in 0.889s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b2dbfd-49f6-421e-9c77-bf2719de31a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57d18c52-e585-44dd-8c94-101e534cf381', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98dae803-0243-43c9-a71e-b1ed879cf6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:17 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Volume volume-57d18c52-e585-44dd-8c94-101e534cf381 (57d18c52-e585-44dd-8c94-101e534cf381): created successfully Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98dae803-0243-43c9-a71e-b1ed879cf6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Flow 'volume_create_manager' (73eb11a3-1718-455d-b882-4eeede2cc30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:31:17 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-bae2639b-6e11-468a-90a3-bc3e37aba427 tempest-CinderUnicodeTest-1798328983 None] Created volume successfully. Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Flow 'volume_create_manager' (06b5ec10-7d26-4034-8721-5416a31bc47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af2df1a-6eee-4133-959b-4845093883a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af2df1a-6eee-4133-959b-4845093883a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-74724744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68977bc2-c8a6-481b-a2b0-68bdc59f9361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bc6de666da4e87bd9f359e704fecf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:31:18Z,use_quota=True,user_id='38448391fe4b4f888f7468e5a6f9964e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c024a0-6a4c-48cc-bbf9-b05244a053e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53c024a0-6a4c-48cc-bbf9-b05244a053e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26824693-3326-4d81-ba0c-58ffdb73bcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26824693-3326-4d81-ba0c-58ffdb73bcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68977bc2-c8a6-481b-a2b0-68bdc59f9361', 'volume_name': 'volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81ed9df-0717-4818-8fda-70f365f89822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81ed9df-0717-4818-8fda-70f365f89822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9033009-e3f7-4c41-8a91-aa62aa419ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:17 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Volume 68977bc2-c8a6-481b-a2b0-68bdc59f9361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361', 'volume_size': 1} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-74724744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68977bc2-c8a6-481b-a2b0-68bdc59f9361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51bc6de666da4e87bd9f359e704fecf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:31:18Z,use_quota=True,user_id='38448391fe4b4f888f7468e5a6f9964e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:31:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Creating volume 68977bc2-c8a6-481b-a2b0-68bdc59f9361 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:31:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:31:18 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:31:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:18 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 1073741824 Feb 26 20:31:18 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:18 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 1073741824" returned: 0 in 0.763s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:18 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 Feb 26 20:31:18 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:19 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361" returned: 0 in 0.599s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:31:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.347s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9033009-e3f7-4c41-8a91-aa62aa419ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2283c9-6815-43ff-b1a8-1bb701bae90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] Creating offline snapshot 26e2d649-df8a-4f0e-a253-363123b8af8d of volume 57d18c52-e585-44dd-8c94-101e534cf381 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:31:19 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Volume volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 (68977bc2-c8a6-481b-a2b0-68bdc59f9361): created successfully Feb 26 20:31:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee2283c9-6815-43ff-b1a8-1bb701bae90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Flow 'volume_create_manager' (06b5ec10-7d26-4034-8721-5416a31bc47e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:31:19 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[920e6dcf-0094-4253-8104-833aeed0d0a7]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:19 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-60d0ffd6-b6b0-4f1e-aa37-9811d8a05b3d req-34fbe095-cbbd-4ce3-93ef-3a55f7d026b0 tempest-VolumesSnapshotsTestJSON-1413708874 None] Created volume successfully. Feb 26 20:31:19 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 Feb 26 20:31:19 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:20 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381" returned: 0 in 0.689s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:20 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d 1G Feb 26 20:31:20 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:20 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d 1G" returned: 0 in 0.576s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d18c52-e585-44dd-8c94-101e534cf381 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:20 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d18c52-e585-44dd-8c94-101e534cf381 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d Feb 26 20:31:20 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:21 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57d18c52-e585-44dd-8c94-101e534cf381 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d" returned: 0 in 0.582s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:21 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d is being set with open permissions: ugo+rw Feb 26 20:31:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:21 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d Feb 26 20:31:21 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:21 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d" returned: 0 in 0.564s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:21 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.info Feb 26 20:31:21 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:22 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.info" returned: 0 in 0.507s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:22 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.info is being set with open permissions: ugo+rw Feb 26 20:31:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:22 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.info Feb 26 20:31:22 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:23 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.info" returned: 0 in 0.664s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.692s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.845s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] Creating offline snapshot a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 of volume 68977bc2-c8a6-481b-a2b0-68bdc59f9361 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:31:23 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-923a4cca-71ce-474d-9a83-dd663df7ec96 tempest-CinderUnicodeTest-1798328983 None] Create snapshot completed successfully Feb 26 20:31:23 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0e9d12-8b63-4c75-8748-35e8a4ec85fd]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:23 devstack sudo[89502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 Feb 26 20:31:23 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:23 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361" returned: 0 in 0.767s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:23 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 1G Feb 26 20:31:23 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG oslo_service.periodic_task [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83352) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:24 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "cinder-26e2d649-df8a-4f0e-a253-363123b8af8d-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:24 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-26e2d649-df8a-4f0e-a253-363123b8af8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "cinder-quobyte-57d18c52-e585-44dd-8c94-101e534cf381" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-quobyte-57d18c52-e585-44dd-8c94-101e534cf381" acquired by "delete_snapshot" :: waited 0.027s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "cinder-quobyte-26e2d649-df8a-4f0e-a253-363123b8af8d" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-quobyte-26e2d649-df8a-4f0e-a253-363123b8af8d" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Deleting offline snapshot 26e2d649-df8a-4f0e-a253-363123b8af8d of volume 57d18c52-e585-44dd-8c94-101e534cf381 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] snapshot_file for this snap is: volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b70526-75ff-449a-92ce-a9f9bc4d1844]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:24 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d Feb 26 20:31:24 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:25 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 1G" returned: 0 in 1.369s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:25 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 Feb 26 20:31:25 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:25 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 1.556s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:25 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:26 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d" returned: 0 in 1.579s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57d18c52-e585-44dd-8c94-101e534cf381(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:31:26 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[5531e984-b9b6-4ff2-9e6c-1a18d2400f16]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:26 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59" returned: 0 in 0.924s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:26 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 is being set with open permissions: ugo+rw Feb 26 20:31:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:26 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 Feb 26 20:31:26 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:26 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 Feb 26 20:31:26 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:27 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59" returned: 0 in 0.842s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:27 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.info Feb 26 20:31:27 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:27 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381" returned: 0 in 1.207s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:27 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d Feb 26 20:31:27 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:27 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.info" returned: 0 in 0.832s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:27 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.info is being set with open permissions: ugo+rw Feb 26 20:31:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:28 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.info Feb 26 20:31:28 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:28 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d" returned: 0 in 0.816s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:28 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d Feb 26 20:31:28 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:28 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.info" returned: 0 in 0.640s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.509s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:28 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-0a2f26ba-6454-4c0a-aecf-358149f6f958 req-24d6caad-857a-4a23-991d-f87843390806 tempest-VolumesSnapshotsTestJSON-1413708874 None] Create snapshot completed successfully Feb 26 20:31:28 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381.26e2d649-df8a-4f0e-a253-363123b8af8d" returned: 0 in 0.605s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-quobyte-26e2d649-df8a-4f0e-a253-363123b8af8d" released by "_delete_snapshot" :: held 4.334s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-quobyte-57d18c52-e585-44dd-8c94-101e534cf381" released by "delete_snapshot" :: held 4.404s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:28 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Created reservations ['b4202db8-d7f6-4f07-84b6-85f952aae32a', '62763dd1-0e24-4b5e-ab66-6d9866b25754', '6fd6e13c-86f8-457b-bc88-ae06e2682c56', 'a494dfad-a6dd-4194-94b1-59336defef2f'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:28 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Delete snapshot completed successfully. Feb 26 20:31:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8f32e0e1-7fcf-4ed0-bcd9-9d6733b3f2f3 tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-26e2d649-df8a-4f0e-a253-363123b8af8d-delete_snapshot" released by "delete_snapshot" :: held 4.611s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Acquiring lock "cinder-a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "cinder-a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Acquiring lock "cinder-quobyte-68977bc2-c8a6-481b-a2b0-68bdc59f9361" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "cinder-quobyte-68977bc2-c8a6-481b-a2b0-68bdc59f9361" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Acquiring lock "cinder-quobyte-a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "cinder-quobyte-a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Deleting offline snapshot a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 of volume 68977bc2-c8a6-481b-a2b0-68bdc59f9361 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] snapshot_file for this snap is: volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4759c0-435c-44ae-81e2-16427d9d6503]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:29 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 Feb 26 20:31:29 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "cinder-57d18c52-e585-44dd-8c94-101e534cf381-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-57d18c52-e585-44dd-8c94-101e534cf381-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:29 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59" returned: 0 in 0.659s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60055ab-67ea-421a-b920-73045a332710]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "cinder-quobyte-57d18c52-e585-44dd-8c94-101e534cf381" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-quobyte-57d18c52-e585-44dd-8c94-101e534cf381" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dd5b85-e068-4cc4-9465-61779abf931b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:29 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 Feb 26 20:31:29 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:29 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 Feb 26 20:31:29 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:29 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Flow 'volume_create_manager' (8e5a1256-d689-4916-b9b0-e0ad9b0a7274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9178f0d3-7f35-45ce-a1a9-7df53d1a3937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9178f0d3-7f35-45ce-a1a9-7df53d1a3937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1647768080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fd1585-30fd-4811-ad67-877ad003717f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b2717582d0483ca13981555454df91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:31:30Z,use_quota=True,user_id='233d9fb4ff4b419bb7ae802b8f6e89e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bdf762-4839-4294-89ec-789c0fb43d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bdf762-4839-4294-89ec-789c0fb43d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81513077-b616-4c7a-8adb-444421b9f736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81513077-b616-4c7a-8adb-444421b9f736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89fd1585-30fd-4811-ad67-877ad003717f', 'volume_name': 'volume-89fd1585-30fd-4811-ad67-877ad003717f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbc9a17-4a7a-4541-9d4b-30c59d57b418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbc9a17-4a7a-4541-9d4b-30c59d57b418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795c170d-fe89-43bb-8ca5-5fe546cbdaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:30 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Volume 89fd1585-30fd-4811-ad67-877ad003717f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89fd1585-30fd-4811-ad67-877ad003717f', 'volume_size': 1} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1647768080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89fd1585-30fd-4811-ad67-877ad003717f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b2717582d0483ca13981555454df91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:31:30Z,use_quota=True,user_id='233d9fb4ff4b419bb7ae802b8f6e89e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Creating volume 89fd1585-30fd-4811-ad67-877ad003717f {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:31:30 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:30 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f 1073741824 Feb 26 20:31:30 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:30 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:30 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361" returned: 0 in 0.690s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381" returned: 0 in 0.641s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:30 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 Feb 26 20:31:30 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:30 devstack sudo[89596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381 Feb 26 20:31:30 devstack sudo[89596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:30 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f 1073741824" returned: 0 in 0.670s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:30 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f Feb 26 20:31:30 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:30 devstack sudo[89596]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-57d18c52-e585-44dd-8c94-101e534cf381" returned: 0 in 0.486s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-quobyte-57d18c52-e585-44dd-8c94-101e534cf381" released by "delete_volume" :: held 1.165s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Created reservations ['96447719-49f9-46f5-a437-ffa4b5e58d0d', 'e93ac478-a1db-4b40-b2a0-328c4400f3e2', '0f993c1e-4065-401c-af28-87ec7b7dc873', '7cdf8ba1-f6f4-4fed-bcec-da2580f9812d'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:31 devstack sudo[89608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:31 devstack sudo[89608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:31 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59" returned: 0 in 0.779s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:31 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59 Feb 26 20:31:31 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:31 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f" returned: 0 in 0.476s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (795c170d-fe89-43bb-8ca5-5fe546cbdaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89fd1585-30fd-4811-ad67-877ad003717f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948120f2-4b77-470d-826d-92cee58c4a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:31 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Volume volume-89fd1585-30fd-4811-ad67-877ad003717f (89fd1585-30fd-4811-ad67-877ad003717f): created successfully Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (948120f2-4b77-470d-826d-92cee58c4a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Flow 'volume_create_manager' (8e5a1256-d689-4916-b9b0-e0ad9b0a7274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:31:31 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b5481819-763e-4a27-b921-5576c72550de tempest-SnapshotDependencyTests-198731408 None] Created volume successfully. Feb 26 20:31:31 devstack sudo[89608]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.500s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:31 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Deleted volume successfully. Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b906de6b-a222-44ed-a55b-8ba5145f5ffe tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-57d18c52-e585-44dd-8c94-101e534cf381-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:31 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361.a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59" returned: 0 in 0.458s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "cinder-quobyte-a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59" released by "_delete_snapshot" :: held 2.696s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "cinder-quobyte-68977bc2-c8a6-481b-a2b0-68bdc59f9361" released by "delete_snapshot" :: held 2.708s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.quota [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Created reservations ['a5949e51-c71a-4986-a649-687b490def34', '0c884734-362a-4358-a69d-dff5673ff021', '9b4186e5-0df0-470e-9552-4de0de01622a', '6dc25b0e-478b-4e27-858f-b7c5fa25bcd1'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:31 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Delete snapshot completed successfully. Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-ada579e3-10aa-4e96-bc68-4474b1361ffe req-f0fbec78-63e7-4a6d-b150-2cc8bcc6ac70 tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "cinder-a58aa145-c4fa-4aa8-8f7a-4ffc387c3f59-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "cinder-63528e9f-ce55-42f9-9801-e352f209633c-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-63528e9f-ce55-42f9-9801-e352f209633c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "cinder-quobyte-63528e9f-ce55-42f9-9801-e352f209633c" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-quobyte-63528e9f-ce55-42f9-9801-e352f209633c" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83d0a91-9a43-4c37-a7c0-08fd2f65e477]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-63528e9f-ce55-42f9-9801-e352f209633c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:32 devstack sudo[89615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-63528e9f-ce55-42f9-9801-e352f209633c Feb 26 20:31:32 devstack sudo[89615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Acquiring lock "cinder-68977bc2-c8a6-481b-a2b0-68bdc59f9361-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "cinder-68977bc2-c8a6-481b-a2b0-68bdc59f9361-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] Creating offline snapshot 828c5632-260d-4269-9aaf-343012f439ab of volume 89fd1585-30fd-4811-ad67-877ad003717f {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee89ea4d-3253-4bb0-9610-7a006cfebe4d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Acquiring lock "cinder-quobyte-68977bc2-c8a6-481b-a2b0-68bdc59f9361" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "cinder-quobyte-68977bc2-c8a6-481b-a2b0-68bdc59f9361" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc957ab2-b760-4520-978e-ddeae6720fdb]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:32 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f Feb 26 20:31:32 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:32 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 Feb 26 20:31:32 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:32 devstack sudo[89615]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-63528e9f-ce55-42f9-9801-e352f209633c" returned: 0 in 0.657s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-63528e9f-ce55-42f9-9801-e352f209633c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:32 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-63528e9f-ce55-42f9-9801-e352f209633c Feb 26 20:31:32 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:32 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f" returned: 0 in 0.592s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:33 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab 1G Feb 26 20:31:33 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:33 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361" returned: 0 in 0.572s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:33 devstack sudo[89635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361 Feb 26 20:31:33 devstack sudo[89635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:33 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-63528e9f-ce55-42f9-9801-e352f209633c" returned: 0 in 0.530s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-quobyte-63528e9f-ce55-42f9-9801-e352f209633c" released by "delete_volume" :: held 1.216s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Created reservations ['d3b4ae46-3959-45b0-9389-354993679667', '608c97af-cfe8-42c9-9492-dafb5e23b8d2', 'a6673389-8658-484e-8f09-47f72af4ba79', 'bcc3c152-0825-45c6-9d06-a5907c704a13'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:33 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:33 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:33 devstack sudo[89635]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-68977bc2-c8a6-481b-a2b0-68bdc59f9361" returned: 0 in 0.554s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "cinder-quobyte-68977bc2-c8a6-481b-a2b0-68bdc59f9361" released by "delete_volume" :: held 1.161s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG cinder.quota [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Created reservations ['da2ee7dd-517d-43a3-9b7f-b028d6a3c460', 'fe7a8eeb-86a8-490c-969f-04c4a2452c82', 'e7486115-2014-4df2-a996-a13feaa9df69', '14aad1eb-a851-4668-a0e2-495907aaafd2'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:33 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab 1G" returned: 0 in 0.646s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fd1585-30fd-4811-ad67-877ad003717f -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:33 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fd1585-30fd-4811-ad67-877ad003717f -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab Feb 26 20:31:33 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:33 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:33 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:33 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.584s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:33 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Deleted volume successfully. Feb 26 20:31:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1c158c6e-b556-4552-a43f-2014f37300a1 tempest-CinderUnicodeTest-1798328983 None] Lock "cinder-63528e9f-ce55-42f9-9801-e352f209633c-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:34 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.559s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:34 devstack cinder-volume[83352]: DEBUG cinder.manager [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:34 devstack cinder-volume[83352]: INFO cinder.volume.manager [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Deleted volume successfully. Feb 26 20:31:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [req-9e05a120-26d9-4e57-b04a-073ffdc85efd req-ad59191e-5e6a-42c2-b1d2-bcb968a90e5f tempest-VolumesSnapshotsTestJSON-1413708874 None] Lock "cinder-68977bc2-c8a6-481b-a2b0-68bdc59f9361-delete_volume" released by "delete_volume" :: held 1.953s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:34 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89fd1585-30fd-4811-ad67-877ad003717f -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab" returned: 0 in 0.679s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:34 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab is being set with open permissions: ugo+rw Feb 26 20:31:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:34 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab Feb 26 20:31:34 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:34 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab" returned: 0 in 0.536s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:34 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.info Feb 26 20:31:34 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:35 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.info" returned: 0 in 0.596s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:35 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.info is being set with open permissions: ugo+rw Feb 26 20:31:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:35 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.info Feb 26 20:31:35 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:36 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.info" returned: 0 in 0.575s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.724s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:36 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-4d083c00-c557-41a2-a533-3bddd72432b0 tempest-SnapshotDependencyTests-198731408 None] Create snapshot completed successfully Feb 26 20:31:36 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:31:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Flow 'volume_create_manager' (9ddedba2-9d00-4fc6-9938-b4ba03fb53c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:31:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011a1c98-2bf6-4c92-bbfc-60fab4217fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011a1c98-2bf6-4c92-bbfc-60fab4217fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a8b001-aeb6-41f7-85c9-4445c7e1f613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4b2717582d0483ca13981555454df91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=828c5632-260d-4269-9aaf-343012f439ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:31:37Z,use_quota=True,user_id='233d9fb4ff4b419bb7ae802b8f6e89e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f18eaf-f6a2-46c2-91e1-a82d0d9859d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f18eaf-f6a2-46c2-91e1-a82d0d9859d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776ba7a2-779c-493b-943a-0656dc797c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776ba7a2-779c-493b-943a-0656dc797c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '17a8b001-aeb6-41f7-85c9-4445c7e1f613', 'volume_name': 'volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613', 'volume_size': 1, 'snapshot_id': '828c5632-260d-4269-9aaf-343012f439ab'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbcf9d6-77af-4862-85dd-78dc8bf7df75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fbcf9d6-77af-4862-85dd-78dc8bf7df75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2210cede-3615-41c5-a90d-65928bee6939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:37 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Volume 17a8b001-aeb6-41f7-85c9-4445c7e1f613: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613', 'volume_size': 1, 'snapshot_id': '828c5632-260d-4269-9aaf-343012f439ab'} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "cinder-quobyte-828c5632-260d-4269-9aaf-343012f439ab-17a8b001-aeb6-41f7-85c9-4445c7e1f613" by "_create_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-quobyte-828c5632-260d-4269-9aaf-343012f439ab-17a8b001-aeb6-41f7-85c9-4445c7e1f613" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Creating volume 17a8b001-aeb6-41f7-85c9-4445c7e1f613 from snapshot 828c5632-260d-4269-9aaf-343012f439ab {{(pid=83352) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "cinder-quobyte-17a8b001-aeb6-41f7-85c9-4445c7e1f613" by "_copy_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-quobyte-17a8b001-aeb6-41f7-85c9-4445c7e1f613" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] snapshot: 828c5632-260d-4269-9aaf-343012f439ab, volume: 17a8b001-aeb6-41f7-85c9-4445c7e1f613, {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0321349b-e310-43a3-8d33-c3ca9474a233]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:37 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab Feb 26 20:31:37 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:37 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab" returned: 0 in 0.648s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89fd1585-30fd-4811-ad67-877ad003717f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Creating direct copy from snapshot {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a55eb1-1a51-4ad5-b006-40d5e4939b18]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:37 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f Feb 26 20:31:37 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:38 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f" returned: 0 in 0.652s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:38 devstack cinder-volume[83352]: DEBUG cinder.utils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Path /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613 not found in is_blk_device check {{(pid=83352) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 20:31:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:38 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613 Feb 26 20:31:38 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:40 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Acquiring lock "cinder-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:40 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Lock "cinder-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:40 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Acquiring lock "cinder-quobyte-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:40 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Lock "cinder-quobyte-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c" acquired by "delete_volume" :: waited 0.026s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:40 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[9028c8c6-48fc-447a-a944-910ced5bcf7a]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:40 devstack sudo[89697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c Feb 26 20:31:40 devstack sudo[89697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:41 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613" returned: 0 in 2.858s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:41 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[804c48b1-0e7b-4938-bba4-66d9c93d3bac]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:41 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f Feb 26 20:31:41 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:41 devstack sudo[89697]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c" returned: 0 in 0.710s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:41 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c Feb 26 20:31:41 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:41 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c" returned: 0 in 0.443s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Lock "cinder-quobyte-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c" released by "delete_volume" :: held 1.187s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:41 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Created reservations ['b40c0b0c-707b-4eff-ae17-a08a07fb2322', '6c14b39f-ade3-44c8-9235-231a842c274c', '975265a9-2ab6-4880-9d99-f58d88d94d11', 'b674365e-ae79-434f-858a-78caf46f7940'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:42 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:42 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:42 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f" returned: 0 in 0.784s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f, size 1024.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613 {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:31:42 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Converted 1024.00 MB image at 358.08 MB/s Feb 26 20:31:42 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613 is being set with open permissions: ugo+rw Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:42 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613 Feb 26 20:31:42 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:42 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.484s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:42 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Deleted volume successfully. Feb 26 20:31:42 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613" returned: 0 in 0.449s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-quobyte-17a8b001-aeb6-41f7-85c9-4445c7e1f613" released by "_copy_volume_from_snapshot" :: held 5.466s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-43c327b4-aafe-4434-8d02-7dbd4a8ee1a0 tempest-VolumesNegativeTest-1630032600 None] Lock "cinder-0df0ebb9-016d-422b-b0ec-a1d6a1c9f76c-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-quobyte-828c5632-260d-4269-9aaf-343012f439ab-17a8b001-aeb6-41f7-85c9-4445c7e1f613" released by "_create_volume_from_snapshot" :: held 5.490s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.505s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2210cede-3615-41c5-a90d-65928bee6939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613', 'volume_size': 1, 'snapshot_id': '828c5632-260d-4269-9aaf-343012f439ab'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8980164-9eab-423b-922d-38a98c40c166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:31:42 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Volume volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613 (17a8b001-aeb6-41f7-85c9-4445c7e1f613): created successfully Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8980164-9eab-423b-922d-38a98c40c166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Flow 'volume_create_manager' (9ddedba2-9d00-4fc6-9938-b4ba03fb53c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:31:42 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a3750e05-e92e-45c1-a997-c9969dc6ceb6 tempest-SnapshotDependencyTests-198731408 None] Created volume successfully. Feb 26 20:31:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-133462c7-105d-492b-9746-0e1e19eb902d tempest-BackendsCapabilitiesAdminTestsJSON-340947989 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83352) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 26 20:31:43 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-dac25f1a-a52f-417f-83b8-7bd5230422ad tempest-BackendsCapabilitiesAdminTestsJSON-340947989 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580490112305, 'free_capacity_gb': 1775.7580490112305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83352) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Feb 26 20:31:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "cinder-828c5632-260d-4269-9aaf-343012f439ab-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-828c5632-260d-4269-9aaf-343012f439ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "cinder-quobyte-89fd1585-30fd-4811-ad67-877ad003717f" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-quobyte-89fd1585-30fd-4811-ad67-877ad003717f" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "cinder-quobyte-828c5632-260d-4269-9aaf-343012f439ab" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-quobyte-828c5632-260d-4269-9aaf-343012f439ab" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Deleting offline snapshot 828c5632-260d-4269-9aaf-343012f439ab of volume 89fd1585-30fd-4811-ad67-877ad003717f {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:31:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] snapshot_file for this snap is: volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:31:43 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbf8254-64eb-45ab-bc58-74d253db954d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:43 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab Feb 26 20:31:43 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:44 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab" returned: 0 in 0.558s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89fd1585-30fd-4811-ad67-877ad003717f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:31:44 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb655ba-5c27-4d7d-8b30-3b5b7b0f9823]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:44 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f Feb 26 20:31:44 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:44 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f" returned: 0 in 0.561s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:44 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab Feb 26 20:31:44 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:45 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab" returned: 0 in 0.536s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:45 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab Feb 26 20:31:45 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:45 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f.828c5632-260d-4269-9aaf-343012f439ab" returned: 0 in 0.481s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:45 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=148,cinder:INSERT=46,cinder:UPDATE=217,cinder:DELETE=12 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:31:45 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=137,cinder:INSERT=52,cinder:UPDATE=172,cinder:DELETE=22 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:31:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-quobyte-828c5632-260d-4269-9aaf-343012f439ab" released by "_delete_snapshot" :: held 2.233s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-quobyte-89fd1585-30fd-4811-ad67-877ad003717f" released by "delete_snapshot" :: held 2.254s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:45 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Created reservations ['524bb15e-46d1-4fe9-a5f1-d47f4268959b', '487ff3d2-56c5-48dd-ab11-5040fedd37d9', 'ecf9ad44-d524-446c-a4af-2640d6d5a74f', '8ffafda0-0ce4-477d-9bd8-fe021db30e06'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:45 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Delete snapshot completed successfully. Feb 26 20:31:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-70f1c74d-742d-4e74-8da3-9efb80b879e2 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-828c5632-260d-4269-9aaf-343012f439ab-delete_snapshot" released by "delete_snapshot" :: held 2.355s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "cinder-89fd1585-30fd-4811-ad67-877ad003717f-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-89fd1585-30fd-4811-ad67-877ad003717f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "cinder-quobyte-89fd1585-30fd-4811-ad67-877ad003717f" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-quobyte-89fd1585-30fd-4811-ad67-877ad003717f" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:46 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c30e16f-ca9b-4ef7-a1f5-514bdca14ac4]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:46 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f Feb 26 20:31:46 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:47 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f" returned: 0 in 0.571s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:47 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f Feb 26 20:31:47 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:47 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-89fd1585-30fd-4811-ad67-877ad003717f" returned: 0 in 0.483s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-quobyte-89fd1585-30fd-4811-ad67-877ad003717f" released by "delete_volume" :: held 1.111s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:47 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Created reservations ['c0d5e6e5-54e0-41d8-a078-973f4de7eb3b', '29d55b26-c789-4e2a-8607-286e1c9ad580', '785b2a87-06e9-4007-b406-c499c092e8fa', '4f7a9fa9-cd1a-46ef-b2fb-a504459541a6'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:47 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:47 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:48 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.446s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:48 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:48 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Deleted volume successfully. Feb 26 20:31:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c64c6c9c-8496-48be-9ac7-88206fc97629 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-89fd1585-30fd-4811-ad67-877ad003717f-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "cinder-17a8b001-aeb6-41f7-85c9-4445c7e1f613-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-17a8b001-aeb6-41f7-85c9-4445c7e1f613-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "cinder-quobyte-17a8b001-aeb6-41f7-85c9-4445c7e1f613" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:31:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-quobyte-17a8b001-aeb6-41f7-85c9-4445c7e1f613" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:31:48 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[be25be7c-ed01-4e91-a946-6eba69d19091]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:31:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:48 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613 Feb 26 20:31:48 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:49 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613" returned: 0 in 0.547s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:49 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613 Feb 26 20:31:49 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:49 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-17a8b001-aeb6-41f7-85c9-4445c7e1f613" returned: 0 in 0.395s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-quobyte-17a8b001-aeb6-41f7-85c9-4445c7e1f613" released by "delete_volume" :: held 0.981s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:49 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Created reservations ['b9cfc733-5283-41cc-b4dc-7ab2b3c5aafd', 'e55abc6d-c630-43c7-9b51-6d942f435f19', '537e3167-6f6b-46ee-92a4-bad5d67aec97', 'bb14b632-005b-45d9-a69e-9212d8d71730'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:49 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:49 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:50 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.482s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:50 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:50 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Deleted volume successfully. Feb 26 20:31:50 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c53912f9-e58e-4a58-9707-fe0a3b83baf1 tempest-SnapshotDependencyTests-198731408 None] Lock "cinder-17a8b001-aeb6-41f7-85c9-4445c7e1f613-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:31:50 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3dea09ac-e920-4ba2-bc3f-56493ffe792a tempest-GroupsV320Test-1354355016 None] Group tempest-GroupsV320Test-Group-1767307856: creating Feb 26 20:31:50 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3dea09ac-e920-4ba2-bc3f-56493ffe792a tempest-GroupsV320Test-1354355016 None] Group tempest-GroupsV320Test-Group-1767307856: created successfully Feb 26 20:31:50 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3dea09ac-e920-4ba2-bc3f-56493ffe792a tempest-GroupsV320Test-1354355016 None] Create group completed successfully. Feb 26 20:31:52 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-b23fa848-6c86-4e33-b4f0-0282d5e8601a tempest-GroupsV320Test-1354355016 None] Created reservations ['341b0b6b-7b91-4141-a1db-1c4eb6c0c397'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:31:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b23fa848-6c86-4e33-b4f0-0282d5e8601a tempest-GroupsV320Test-1354355016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:31:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b23fa848-6c86-4e33-b4f0-0282d5e8601a tempest-GroupsV320Test-1354355016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:31:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b23fa848-6c86-4e33-b4f0-0282d5e8601a tempest-GroupsV320Test-1354355016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:31:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b23fa848-6c86-4e33-b4f0-0282d5e8601a tempest-GroupsV320Test-1354355016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:31:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b23fa848-6c86-4e33-b4f0-0282d5e8601a tempest-GroupsV320Test-1354355016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:31:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b23fa848-6c86-4e33-b4f0-0282d5e8601a tempest-GroupsV320Test-1354355016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:31:52 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:31:52 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:31:52 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Feb 26 20:31:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b23fa848-6c86-4e33-b4f0-0282d5e8601a tempest-GroupsV320Test-1354355016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.477s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:31:52 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-b23fa848-6c86-4e33-b4f0-0282d5e8601a tempest-GroupsV320Test-1354355016 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:31:52 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b23fa848-6c86-4e33-b4f0-0282d5e8601a tempest-GroupsV320Test-1354355016 None] Delete group completed successfully. Feb 26 20:32:02 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=20,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:32:02 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=22,cinder:INSERT=7,cinder:UPDATE=27 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Flow 'volume_create_manager' (aff2a4d1-9e5a-4fb7-b67a-ec5abb8b2644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37af5285-d4fa-4af7-92c9-82a0373a2365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37af5285-d4fa-4af7-92c9-82a0373a2365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1305455264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eefc423-b85d-4590-9404-9ab60a423ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a671ba6c5e74174abf8e1bcf9fa2a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:32:11Z,use_quota=True,user_id='03823916bc9947418f1101931c6857ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f605d0-70e8-4916-a587-721caa895855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f605d0-70e8-4916-a587-721caa895855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2994be-d83a-464f-b726-ca0887c9d6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2994be-d83a-464f-b726-ca0887c9d6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eefc423-b85d-4590-9404-9ab60a423ce4', 'volume_name': 'volume-8eefc423-b85d-4590-9404-9ab60a423ce4', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b229d8-acac-4d19-98c5-c506b8255d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b229d8-acac-4d19-98c5-c506b8255d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811a66a4-1e75-4dba-9003-5d9a6b9df92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:11 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Volume 8eefc423-b85d-4590-9404-9ab60a423ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eefc423-b85d-4590-9404-9ab60a423ce4', 'volume_size': 1} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1305455264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eefc423-b85d-4590-9404-9ab60a423ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a671ba6c5e74174abf8e1bcf9fa2a42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:32:11Z,use_quota=True,user_id='03823916bc9947418f1101931c6857ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Creating volume 8eefc423-b85d-4590-9404-9ab60a423ce4 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:32:11 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:11 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 1073741824 Feb 26 20:32:11 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:11 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 1073741824" returned: 0 in 0.547s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:11 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 Feb 26 20:32:11 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:12 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4" returned: 0 in 0.446s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:32:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811a66a4-1e75-4dba-9003-5d9a6b9df92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eefc423-b85d-4590-9404-9ab60a423ce4', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e02a71-bd28-4ed1-8d0a-4db487d57254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:12 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Volume volume-8eefc423-b85d-4590-9404-9ab60a423ce4 (8eefc423-b85d-4590-9404-9ab60a423ce4): created successfully Feb 26 20:32:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9e02a71-bd28-4ed1-8d0a-4db487d57254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Flow 'volume_create_manager' (aff2a4d1-9e5a-4fb7-b67a-ec5abb8b2644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:32:12 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d160fb18-8ce0-47e4-8688-f671d4c46858 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Created volume successfully. Feb 26 20:32:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:13 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Creating offline snapshot 6a70ff5c-e1fb-4733-96a4-b238b493d43d of volume 8eefc423-b85d-4590-9404-9ab60a423ce4 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:32:13 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5532d2-4aaa-4b70-8565-38a94990d267]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:32:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:13 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 Feb 26 20:32:13 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:13 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4" returned: 0 in 0.508s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:14 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d 1G Feb 26 20:32:14 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:14 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d 1G" returned: 0 in 0.556s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eefc423-b85d-4590-9404-9ab60a423ce4 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:14 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eefc423-b85d-4590-9404-9ab60a423ce4 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d Feb 26 20:32:14 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:15 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eefc423-b85d-4590-9404-9ab60a423ce4 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d" returned: 0 in 0.569s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:15 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d is being set with open permissions: ugo+rw Feb 26 20:32:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:15 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d Feb 26 20:32:15 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:15 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d" returned: 0 in 0.456s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:15 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.info Feb 26 20:32:15 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:16 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.info" returned: 0 in 0.462s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:16 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.info is being set with open permissions: ugo+rw Feb 26 20:32:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:16 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.info Feb 26 20:32:16 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:16 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.info" returned: 0 in 0.440s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.070s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:16 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-068bcea4-6a1b-485c-8a9c-d58503671e3d tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Create snapshot completed successfully Feb 26 20:32:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Acquiring lock "cinder-6a70ff5c-e1fb-4733-96a4-b238b493d43d-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "cinder-6a70ff5c-e1fb-4733-96a4-b238b493d43d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Acquiring lock "cinder-quobyte-8eefc423-b85d-4590-9404-9ab60a423ce4" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "cinder-quobyte-8eefc423-b85d-4590-9404-9ab60a423ce4" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Acquiring lock "cinder-quobyte-6a70ff5c-e1fb-4733-96a4-b238b493d43d" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "cinder-quobyte-6a70ff5c-e1fb-4733-96a4-b238b493d43d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Deleting offline snapshot 6a70ff5c-e1fb-4733-96a4-b238b493d43d of volume 8eefc423-b85d-4590-9404-9ab60a423ce4 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:32:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] snapshot_file for this snap is: volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:32:17 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[320a6940-c574-4734-8c75-6f9dadefeca1]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:32:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:18 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d Feb 26 20:32:18 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:18 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d" returned: 0 in 0.493s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8eefc423-b85d-4590-9404-9ab60a423ce4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:32:18 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1556e9-160a-41a9-b878-1b1493bd4563]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:32:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:18 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 Feb 26 20:32:18 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:18 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4" returned: 0 in 0.521s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:19 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d Feb 26 20:32:19 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:19 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d" returned: 0 in 0.498s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:19 devstack sudo[89852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d Feb 26 20:32:19 devstack sudo[89852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:19 devstack sudo[89852]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4.6a70ff5c-e1fb-4733-96a4-b238b493d43d" returned: 0 in 0.414s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "cinder-quobyte-6a70ff5c-e1fb-4733-96a4-b238b493d43d" released by "_delete_snapshot" :: held 1.991s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "cinder-quobyte-8eefc423-b85d-4590-9404-9ab60a423ce4" released by "delete_snapshot" :: held 2.005s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:19 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Created reservations ['2fe05651-7bbc-4f0f-818b-62611af1080d', '5a720374-615d-43f2-8d15-68b73e97139d', '1585c660-2487-4055-a54b-63dfc6d8b07c', '0147bc0b-fd9d-45e7-9b09-2d31d488c171'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:32:20 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Delete snapshot completed successfully. Feb 26 20:32:20 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2107d14b-4a84-4651-b367-f4c9a22c6890 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "cinder-6a70ff5c-e1fb-4733-96a4-b238b493d43d-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Acquiring lock "cinder-8eefc423-b85d-4590-9404-9ab60a423ce4-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "cinder-8eefc423-b85d-4590-9404-9ab60a423ce4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Acquiring lock "cinder-quobyte-8eefc423-b85d-4590-9404-9ab60a423ce4" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "cinder-quobyte-8eefc423-b85d-4590-9404-9ab60a423ce4" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:21 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0451705b-a965-47d2-9394-ae20765e38f8]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:32:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:21 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 Feb 26 20:32:21 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:21 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4" returned: 0 in 0.509s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:21 devstack sudo[89860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4 Feb 26 20:32:21 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:22 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8eefc423-b85d-4590-9404-9ab60a423ce4" returned: 0 in 0.439s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "cinder-quobyte-8eefc423-b85d-4590-9404-9ab60a423ce4" released by "delete_volume" :: held 0.991s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:22 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Created reservations ['7bc8784c-87e6-45a0-9036-b440c1e26291', 'ceadde9d-938a-4fd4-b92c-feb212972e85', '911e1680-43e0-4c3c-8144-4f45df513da1', '0eee4de2-540f-42cf-84e4-9c31bf0f33ee'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:32:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:22 devstack sudo[89863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:32:22 devstack sudo[89863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:22 devstack sudo[89863]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.487s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:22 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:32:22 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Deleted volume successfully. Feb 26 20:32:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b3a9b0b-bc7b-4cc6-a1c0-52b8e55098a2 tempest-VolumeSnapshotQuotasNegativeTestJSON-323184167 None] Lock "cinder-8eefc423-b85d-4590-9404-9ab60a423ce4-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:24 devstack cinder-volume[83352]: DEBUG oslo_service.periodic_task [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83352) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:32:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:24 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:32:24 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:24 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.505s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:24 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Flow 'volume_create_manager' (727f619b-1e17-4bf2-9f60-08bcc7506901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e373dd2-8ae0-4ea9-a6d1-a150b6deaf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e373dd2-8ae0-4ea9-a6d1-a150b6deaf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1788833855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5311e33e-883c-473f-9e21-60e9ce22392b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da4a8c578a04eb68fb277ed9bb09d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:32:27Z,use_quota=True,user_id='bafc02b2cd3145f0bb7aa801dc5a0bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbba9b1a-53f3-4b6e-9db3-4e0af73825f6),volume_type_id=dbba9b1a-53f3-4b6e-9db3-4e0af73825f6)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ccbe849-b437-48f9-9064-1aec9b8641f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ccbe849-b437-48f9-9064-1aec9b8641f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da5955d-cbc3-47cc-beab-3b598512d275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da5955d-cbc3-47cc-beab-3b598512d275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5311e33e-883c-473f-9e21-60e9ce22392b', 'volume_name': 'volume-5311e33e-883c-473f-9e21-60e9ce22392b', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31375963-dfd9-4c04-be46-27ab1c567978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31375963-dfd9-4c04-be46-27ab1c567978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b64ac5-c254-4754-8c95-957bc2e15d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:26 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Volume 5311e33e-883c-473f-9e21-60e9ce22392b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5311e33e-883c-473f-9e21-60e9ce22392b', 'volume_size': 1} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1788833855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5311e33e-883c-473f-9e21-60e9ce22392b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1da4a8c578a04eb68fb277ed9bb09d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:32:27Z,use_quota=True,user_id='bafc02b2cd3145f0bb7aa801dc5a0bb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dbba9b1a-53f3-4b6e-9db3-4e0af73825f6),volume_type_id=dbba9b1a-53f3-4b6e-9db3-4e0af73825f6)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Creating volume 5311e33e-883c-473f-9e21-60e9ce22392b {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:32:26 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:32:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5311e33e-883c-473f-9e21-60e9ce22392b 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:26 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5311e33e-883c-473f-9e21-60e9ce22392b 1073741824 Feb 26 20:32:26 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:27 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5311e33e-883c-473f-9e21-60e9ce22392b 1073741824" returned: 0 in 0.519s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5311e33e-883c-473f-9e21-60e9ce22392b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:27 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5311e33e-883c-473f-9e21-60e9ce22392b Feb 26 20:32:27 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:27 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5311e33e-883c-473f-9e21-60e9ce22392b" returned: 0 in 0.460s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:32:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b64ac5-c254-4754-8c95-957bc2e15d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5311e33e-883c-473f-9e21-60e9ce22392b', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db0da87-5f4b-465b-b2ec-db7a6ae427b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:27 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Volume volume-5311e33e-883c-473f-9e21-60e9ce22392b (5311e33e-883c-473f-9e21-60e9ce22392b): created successfully Feb 26 20:32:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db0da87-5f4b-465b-b2ec-db7a6ae427b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Flow 'volume_create_manager' (727f619b-1e17-4bf2-9f60-08bcc7506901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:32:27 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3479629b-0ea8-4440-a083-2e1dfee768b0 tempest-VolumeTypesAccessTest-1843467184 None] Created volume successfully. Feb 26 20:32:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Acquiring lock "cinder-5311e33e-883c-473f-9e21-60e9ce22392b-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Lock "cinder-5311e33e-883c-473f-9e21-60e9ce22392b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Acquiring lock "cinder-quobyte-5311e33e-883c-473f-9e21-60e9ce22392b" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Lock "cinder-quobyte-5311e33e-883c-473f-9e21-60e9ce22392b" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:29 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b5d825-4af8-41fc-99ec-4429b2f40265]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:32:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5311e33e-883c-473f-9e21-60e9ce22392b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:29 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5311e33e-883c-473f-9e21-60e9ce22392b Feb 26 20:32:29 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:29 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5311e33e-883c-473f-9e21-60e9ce22392b" returned: 0 in 0.515s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5311e33e-883c-473f-9e21-60e9ce22392b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:29 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5311e33e-883c-473f-9e21-60e9ce22392b Feb 26 20:32:29 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:30 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5311e33e-883c-473f-9e21-60e9ce22392b" returned: 0 in 0.444s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Lock "cinder-quobyte-5311e33e-883c-473f-9e21-60e9ce22392b" released by "delete_volume" :: held 0.995s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:30 devstack cinder-volume[83352]: WARNING cinder.quota [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-443145502 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-443145502, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:32:30 devstack cinder-volume[83352]: WARNING cinder.quota [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-443145502 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-443145502, it is now deprecated. Please use the default quota class for default quota. Feb 26 20:32:30 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Created reservations ['2df8dfe8-394c-4af1-bba3-bf24e14ae515', '28562a48-664d-40b7-adab-1df4331a7a13', '5a7ef59d-b695-4e30-91dc-08825f11d748', '9dd6a377-57ee-437a-8f71-42067419c9e8'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:32:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:30 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:32:30 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:30 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.420s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:30 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:32:30 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Deleted volume successfully. Feb 26 20:32:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-03fbed74-c954-4a64-8bb7-0276f482f995 tempest-VolumeTypesAccessTest-1843467184 None] Lock "cinder-5311e33e-883c-473f-9e21-60e9ce22392b-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Flow 'volume_create_manager' (ecad8a19-3b16-4351-a377-ab117ff0f25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643ae7d7-a05d-49b4-8fb0-b6f3804b7edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (643ae7d7-a05d-49b4-8fb0-b6f3804b7edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-24841177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e316ba5-de17-4395-9201-e3c32d7eb178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c248563b834cbea9b495c1f31e8597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:32:37Z,use_quota=True,user_id='16151f3b50df47e5b406dff787da3119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3db0f6-6bbb-4c5d-b010-0985681b2420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b3db0f6-6bbb-4c5d-b010-0985681b2420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62dd833-b933-4a87-91c3-08e8a9e746a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62dd833-b933-4a87-91c3-08e8a9e746a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e316ba5-de17-4395-9201-e3c32d7eb178', 'volume_name': 'volume-9e316ba5-de17-4395-9201-e3c32d7eb178', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a837f7e-05ad-4474-ba50-e1dd5cb13eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a837f7e-05ad-4474-ba50-e1dd5cb13eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40850338-2993-46aa-b0af-d264bf4e31e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:36 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Volume 9e316ba5-de17-4395-9201-e3c32d7eb178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e316ba5-de17-4395-9201-e3c32d7eb178', 'volume_size': 1} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-24841177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e316ba5-de17-4395-9201-e3c32d7eb178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c248563b834cbea9b495c1f31e8597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:32:37Z,use_quota=True,user_id='16151f3b50df47e5b406dff787da3119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Creating volume 9e316ba5-de17-4395-9201-e3c32d7eb178 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:32:36 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:32:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9e316ba5-de17-4395-9201-e3c32d7eb178 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:36 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9e316ba5-de17-4395-9201-e3c32d7eb178 1073741824 Feb 26 20:32:36 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:37 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9e316ba5-de17-4395-9201-e3c32d7eb178 1073741824" returned: 0 in 0.605s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9e316ba5-de17-4395-9201-e3c32d7eb178 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:37 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9e316ba5-de17-4395-9201-e3c32d7eb178 Feb 26 20:32:37 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:37 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9e316ba5-de17-4395-9201-e3c32d7eb178" returned: 0 in 0.502s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:32:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:37 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40850338-2993-46aa-b0af-d264bf4e31e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e316ba5-de17-4395-9201-e3c32d7eb178', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:37 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3a1b3d-7abd-4abd-8b85-528237ad416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:37 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Volume volume-9e316ba5-de17-4395-9201-e3c32d7eb178 (9e316ba5-de17-4395-9201-e3c32d7eb178): created successfully Feb 26 20:32:37 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3a1b3d-7abd-4abd-8b85-528237ad416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:37 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Flow 'volume_create_manager' (ecad8a19-3b16-4351-a377-ab117ff0f25f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:32:37 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-50e7e786-6fd9-4f50-85fe-ae84aa622a09 tempest-VolumesListAdminTestJSON-655832111 None] Created volume successfully. Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Flow 'volume_create_manager' (9a9eec1a-61d6-4851-b275-c82c62a5ba80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbb4ce2-676d-49ce-bae1-30aabbf4e699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fbb4ce2-676d-49ce-bae1-30aabbf4e699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-184100861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fa7720-7279-4edf-a636-090c6804ff1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c248563b834cbea9b495c1f31e8597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:32:39Z,use_quota=True,user_id='16151f3b50df47e5b406dff787da3119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12d8ecf-7a9b-46e7-a6f3-ae69803318b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12d8ecf-7a9b-46e7-a6f3-ae69803318b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f7ede9-ff71-4d5d-a78f-51ae8a02d3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f7ede9-ff71-4d5d-a78f-51ae8a02d3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5fa7720-7279-4edf-a636-090c6804ff1f', 'volume_name': 'volume-a5fa7720-7279-4edf-a636-090c6804ff1f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129e4f68-4ab2-4ea4-b127-df4ce38f2a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (129e4f68-4ab2-4ea4-b127-df4ce38f2a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c95974-6e68-4f89-9863-1a539510b5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:39 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Volume a5fa7720-7279-4edf-a636-090c6804ff1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5fa7720-7279-4edf-a636-090c6804ff1f', 'volume_size': 1} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-184100861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5fa7720-7279-4edf-a636-090c6804ff1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c248563b834cbea9b495c1f31e8597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:32:39Z,use_quota=True,user_id='16151f3b50df47e5b406dff787da3119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Creating volume a5fa7720-7279-4edf-a636-090c6804ff1f {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:32:39 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5fa7720-7279-4edf-a636-090c6804ff1f 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:39 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5fa7720-7279-4edf-a636-090c6804ff1f 1073741824 Feb 26 20:32:39 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:39 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5fa7720-7279-4edf-a636-090c6804ff1f 1073741824" returned: 0 in 0.579s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5fa7720-7279-4edf-a636-090c6804ff1f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:39 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5fa7720-7279-4edf-a636-090c6804ff1f Feb 26 20:32:39 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:40 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5fa7720-7279-4edf-a636-090c6804ff1f" returned: 0 in 0.448s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:32:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c95974-6e68-4f89-9863-1a539510b5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5fa7720-7279-4edf-a636-090c6804ff1f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a28e93d-3b80-4462-80e0-7c74601298a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:40 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Volume volume-a5fa7720-7279-4edf-a636-090c6804ff1f (a5fa7720-7279-4edf-a636-090c6804ff1f): created successfully Feb 26 20:32:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a28e93d-3b80-4462-80e0-7c74601298a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Flow 'volume_create_manager' (9a9eec1a-61d6-4851-b275-c82c62a5ba80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:32:40 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-98c61a1e-bbb4-4c41-a9c8-f8fd931b00b1 tempest-VolumesListAdminTestJSON-655832111 None] Created volume successfully. Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Flow 'volume_create_manager' (b5cade18-a4f9-4528-b1cf-131d51670cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be097141-aea5-4d14-af7f-6780ab82fd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be097141-aea5-4d14-af7f-6780ab82fd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-733361824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e218c07b-a070-4ed0-93c4-a225be2d6639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c248563b834cbea9b495c1f31e8597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:32:41Z,use_quota=True,user_id='16151f3b50df47e5b406dff787da3119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af201680-dc9e-4b49-8fc0-2fe3ec7e71c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af201680-dc9e-4b49-8fc0-2fe3ec7e71c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6037caf-e9f3-4b02-b47d-af2bfad11754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6037caf-e9f3-4b02-b47d-af2bfad11754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e218c07b-a070-4ed0-93c4-a225be2d6639', 'volume_name': 'volume-e218c07b-a070-4ed0-93c4-a225be2d6639', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9470d5d-9fd8-41c3-bf05-892b4fc1095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9470d5d-9fd8-41c3-bf05-892b4fc1095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e713599a-d7a4-4eca-973a-51fd10cbe6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:41 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Volume e218c07b-a070-4ed0-93c4-a225be2d6639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e218c07b-a070-4ed0-93c4-a225be2d6639', 'volume_size': 1} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-733361824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e218c07b-a070-4ed0-93c4-a225be2d6639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19c248563b834cbea9b495c1f31e8597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:32:41Z,use_quota=True,user_id='16151f3b50df47e5b406dff787da3119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Creating volume e218c07b-a070-4ed0-93c4-a225be2d6639 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:32:41 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:32:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e218c07b-a070-4ed0-93c4-a225be2d6639 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:41 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e218c07b-a070-4ed0-93c4-a225be2d6639 1073741824 Feb 26 20:32:41 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:42 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e218c07b-a070-4ed0-93c4-a225be2d6639 1073741824" returned: 0 in 0.591s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e218c07b-a070-4ed0-93c4-a225be2d6639 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:42 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e218c07b-a070-4ed0-93c4-a225be2d6639 Feb 26 20:32:42 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:42 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e218c07b-a070-4ed0-93c4-a225be2d6639" returned: 0 in 0.479s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:42 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:32:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e713599a-d7a4-4eca-973a-51fd10cbe6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e218c07b-a070-4ed0-93c4-a225be2d6639', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838b2cec-a25c-4b6e-a573-0c3b4169e1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:42 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Volume volume-e218c07b-a070-4ed0-93c4-a225be2d6639 (e218c07b-a070-4ed0-93c4-a225be2d6639): created successfully Feb 26 20:32:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838b2cec-a25c-4b6e-a573-0c3b4169e1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:42 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Flow 'volume_create_manager' (b5cade18-a4f9-4528-b1cf-131d51670cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:32:42 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-4a46301e-1b9c-4271-9158-6547f002d1c8 tempest-VolumesListAdminTestJSON-655832111 None] Created volume successfully. Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Flow 'volume_create_manager' (e28f856e-f359-4546-8c95-1f3c394ab7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eaeda40-685f-45c3-a954-04557d13f873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eaeda40-685f-45c3-a954-04557d13f873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a90d04-2f22-4543-b534-09de33d79fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e666c3f7a74ab99a26e0192dc80cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:32:44Z,use_quota=True,user_id='debde4c41ad0426bb2b8ba5ce36d0ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186da0fe-aff6-40f6-ae5d-d24fde022635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (186da0fe-aff6-40f6-ae5d-d24fde022635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62720d9d-7f21-4021-8ba1-66836f6cce33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62720d9d-7f21-4021-8ba1-66836f6cce33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a90d04-2f22-4543-b534-09de33d79fda', 'volume_name': 'volume-82a90d04-2f22-4543-b534-09de33d79fda', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f55542-9cd2-4e15-a33a-ceae9d13a706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f55542-9cd2-4e15-a33a-ceae9d13a706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de61c1e-d4d3-49e9-8e3a-038302e0db01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:44 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Volume 82a90d04-2f22-4543-b534-09de33d79fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a90d04-2f22-4543-b534-09de33d79fda', 'volume_size': 1} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a90d04-2f22-4543-b534-09de33d79fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e666c3f7a74ab99a26e0192dc80cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:32:44Z,use_quota=True,user_id='debde4c41ad0426bb2b8ba5ce36d0ff7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Creating volume 82a90d04-2f22-4543-b534-09de33d79fda {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:32:44 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-82a90d04-2f22-4543-b534-09de33d79fda 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:44 devstack sudo[89921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-82a90d04-2f22-4543-b534-09de33d79fda 1073741824 Feb 26 20:32:44 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:44 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-82a90d04-2f22-4543-b534-09de33d79fda 1073741824" returned: 0 in 0.538s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-82a90d04-2f22-4543-b534-09de33d79fda {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:44 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-82a90d04-2f22-4543-b534-09de33d79fda Feb 26 20:32:44 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:45 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-82a90d04-2f22-4543-b534-09de33d79fda" returned: 0 in 0.451s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:32:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9de61c1e-d4d3-49e9-8e3a-038302e0db01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a90d04-2f22-4543-b534-09de33d79fda', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311fae14-bdf0-484e-8b84-2212d4b61fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:32:45 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Volume volume-82a90d04-2f22-4543-b534-09de33d79fda (82a90d04-2f22-4543-b534-09de33d79fda): created successfully Feb 26 20:32:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311fae14-bdf0-484e-8b84-2212d4b61fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:32:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Flow 'volume_create_manager' (e28f856e-f359-4546-8c95-1f3c394ab7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:32:45 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-2a06fe03-aef6-47f2-a744-94397f6f462e tempest-VolumesListAdminTestJSON-1373862989 None] Created volume successfully. Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Acquiring lock "cinder-82a90d04-2f22-4543-b534-09de33d79fda-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Lock "cinder-82a90d04-2f22-4543-b534-09de33d79fda-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Acquiring lock "cinder-quobyte-82a90d04-2f22-4543-b534-09de33d79fda" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Lock "cinder-quobyte-82a90d04-2f22-4543-b534-09de33d79fda" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6b7954-69e6-438a-9bff-7599dff1c316]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-82a90d04-2f22-4543-b534-09de33d79fda {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "cinder-e218c07b-a070-4ed0-93c4-a225be2d6639-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Lock "cinder-e218c07b-a070-4ed0-93c4-a225be2d6639-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:46 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-82a90d04-2f22-4543-b534-09de33d79fda Feb 26 20:32:46 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "cinder-quobyte-e218c07b-a070-4ed0-93c4-a225be2d6639" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Lock "cinder-quobyte-e218c07b-a070-4ed0-93c4-a225be2d6639" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bc961e-21e3-4ecc-8a1a-969ad1ff3c66]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e218c07b-a070-4ed0-93c4-a225be2d6639 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:46 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e218c07b-a070-4ed0-93c4-a225be2d6639 Feb 26 20:32:46 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:46 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-82a90d04-2f22-4543-b534-09de33d79fda" returned: 0 in 0.628s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-82a90d04-2f22-4543-b534-09de33d79fda {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:46 devstack sudo[89971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-82a90d04-2f22-4543-b534-09de33d79fda Feb 26 20:32:46 devstack sudo[89971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:47 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e218c07b-a070-4ed0-93c4-a225be2d6639" returned: 0 in 0.560s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e218c07b-a070-4ed0-93c4-a225be2d6639 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:47 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e218c07b-a070-4ed0-93c4-a225be2d6639 Feb 26 20:32:47 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:47 devstack sudo[89971]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-82a90d04-2f22-4543-b534-09de33d79fda" returned: 0 in 0.448s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Lock "cinder-quobyte-82a90d04-2f22-4543-b534-09de33d79fda" released by "delete_volume" :: held 1.106s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Created reservations ['af553630-6b0b-4706-9819-0821ed1ad085', '545548f3-efbe-422d-86bb-282ece82660b', '8ea55e56-757a-4102-98d8-5f4ca5d9b235', '0a066324-e570-4bcc-92b9-cfd7cc6a9343'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:32:47 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e218c07b-a070-4ed0-93c4-a225be2d6639" returned: 0 in 0.485s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Lock "cinder-quobyte-e218c07b-a070-4ed0-93c4-a225be2d6639" released by "delete_volume" :: held 1.080s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:47 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:32:47 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Created reservations ['209a2d95-a59f-4876-90e5-1d79ee3d6169', '86df8b36-e591-44d4-832e-c79f313d3257', '6e5598b4-6287-490f-8875-b0580f5ed94b', '86a22295-bd3d-42a6-904f-0295cbb6f654'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:47 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:32:47 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:48 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.483s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:48 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:32:48 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Deleted volume successfully. Feb 26 20:32:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9e66e7b3-2401-495d-abab-98cd0d12411c tempest-VolumesListAdminTestJSON-1373862989 None] Lock "cinder-82a90d04-2f22-4543-b534-09de33d79fda-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:48 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.453s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:48 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:32:48 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Deleted volume successfully. Feb 26 20:32:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b532f558-6c53-46ea-8e35-5a5d7f38d844 tempest-VolumesListAdminTestJSON-655832111 None] Lock "cinder-e218c07b-a070-4ed0-93c4-a225be2d6639-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "cinder-a5fa7720-7279-4edf-a636-090c6804ff1f-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Lock "cinder-a5fa7720-7279-4edf-a636-090c6804ff1f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "cinder-quobyte-a5fa7720-7279-4edf-a636-090c6804ff1f" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Lock "cinder-quobyte-a5fa7720-7279-4edf-a636-090c6804ff1f" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:48 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[7992de48-21e0-4285-82fb-401593ced9d8]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:32:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5fa7720-7279-4edf-a636-090c6804ff1f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:48 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5fa7720-7279-4edf-a636-090c6804ff1f Feb 26 20:32:48 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:49 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5fa7720-7279-4edf-a636-090c6804ff1f" returned: 0 in 0.519s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5fa7720-7279-4edf-a636-090c6804ff1f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:49 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5fa7720-7279-4edf-a636-090c6804ff1f Feb 26 20:32:49 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:49 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5fa7720-7279-4edf-a636-090c6804ff1f" returned: 0 in 0.434s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Lock "cinder-quobyte-a5fa7720-7279-4edf-a636-090c6804ff1f" released by "delete_volume" :: held 0.979s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:49 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Created reservations ['03e63392-3af2-49b7-b324-222be71905a7', 'ba5c6827-5092-4ddb-acd6-2156b50ae523', 'cc9c2256-2d84-4d34-982a-43d5ef6de782', '381a6f06-0f38-4706-81f7-0f8b74c039ea'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:32:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:49 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:49 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:32:49 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:50 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.426s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:50 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:32:50 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Deleted volume successfully. Feb 26 20:32:50 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2f065209-b73c-4513-83c4-e82b38c6bc63 tempest-VolumesListAdminTestJSON-655832111 None] Lock "cinder-a5fa7720-7279-4edf-a636-090c6804ff1f-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:50 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "cinder-9e316ba5-de17-4395-9201-e3c32d7eb178-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:50 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Lock "cinder-9e316ba5-de17-4395-9201-e3c32d7eb178-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:50 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "cinder-quobyte-9e316ba5-de17-4395-9201-e3c32d7eb178" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:32:50 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Lock "cinder-quobyte-9e316ba5-de17-4395-9201-e3c32d7eb178" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:32:50 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[616d0beb-5103-4e75-9efe-7ddb2dd25022]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:32:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9e316ba5-de17-4395-9201-e3c32d7eb178 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:51 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9e316ba5-de17-4395-9201-e3c32d7eb178 Feb 26 20:32:51 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:51 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9e316ba5-de17-4395-9201-e3c32d7eb178" returned: 0 in 0.506s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9e316ba5-de17-4395-9201-e3c32d7eb178 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:51 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9e316ba5-de17-4395-9201-e3c32d7eb178 Feb 26 20:32:51 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:51 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-9e316ba5-de17-4395-9201-e3c32d7eb178" returned: 0 in 0.433s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:51 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Lock "cinder-quobyte-9e316ba5-de17-4395-9201-e3c32d7eb178" released by "delete_volume" :: held 0.977s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:32:51 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Created reservations ['d1ad7a77-82c5-42bc-ae9b-8b5c8ebc47a7', '1dd68e53-cceb-47fd-ad3e-377730c78feb', 'e09ebdcc-c07f-4661-8001-942935c6a70c', 'f892d312-dfc7-4d00-9ebc-a637de527a17'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:32:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:32:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:32:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:32:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:32:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:32:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:32:52 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:32:52 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:32:52 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Feb 26 20:32:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.463s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:32:52 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:32:52 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Deleted volume successfully. Feb 26 20:32:52 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-67dfc207-60fe-4b6b-8175-fbb931c1c11e tempest-VolumesListAdminTestJSON-655832111 None] Lock "cinder-9e316ba5-de17-4395-9201-e3c32d7eb178-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Flow 'volume_create_manager' (90bd61f8-a83d-4fbb-b475-93d66ea5fe2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3996f42c-fae2-40f4-bec0-f31918428b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3996f42c-fae2-40f4-bec0-f31918428b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-270164441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9be230-b62e-4f75-a3ec-2ca80ced6eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e05fe6547864a10ae7f8ac884f8d36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:33:01Z,use_quota=True,user_id='938843d99c344a2f99cdfe29cd568cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662c1147-de1b-43a6-ba3c-2aa92d9712a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662c1147-de1b-43a6-ba3c-2aa92d9712a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35524956-6f7d-4cae-9d8d-970ce0d87cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35524956-6f7d-4cae-9d8d-970ce0d87cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9be230-b62e-4f75-a3ec-2ca80ced6eb5', 'volume_name': 'volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d153dcb-fe1e-4799-829a-0d3942775786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d153dcb-fe1e-4799-829a-0d3942775786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a456e55-2eb6-4d05-9e24-ff6a829474ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:33:01 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Volume 7b9be230-b62e-4f75-a3ec-2ca80ced6eb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5', 'volume_size': 1} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-270164441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9be230-b62e-4f75-a3ec-2ca80ced6eb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e05fe6547864a10ae7f8ac884f8d36b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:33:01Z,use_quota=True,user_id='938843d99c344a2f99cdfe29cd568cf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Creating volume 7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:33:01 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:33:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:33:01 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 1073741824 Feb 26 20:33:01 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:33:02 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Feb 26 20:33:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 1073741824" returned: 0 in 0.657s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:33:02 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=53,cinder:UPDATE=75,cinder:INSERT=16,cinder:DELETE=7 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:33:02 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=53,cinder:UPDATE=74,cinder:DELETE=6,cinder:INSERT=19 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:33:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:33:02 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 Feb 26 20:33:02 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:33:02 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Feb 26 20:33:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" returned: 0 in 0.558s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:33:02 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:33:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:33:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a456e55-2eb6-4d05-9e24-ff6a829474ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:33:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e1f6a4-d623-4532-b9eb-cd9a4bee6474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:33:02 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Volume volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 (7b9be230-b62e-4f75-a3ec-2ca80ced6eb5): created successfully Feb 26 20:33:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e1f6a4-d623-4532-b9eb-cd9a4bee6474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:33:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Flow 'volume_create_manager' (90bd61f8-a83d-4fbb-b475-93d66ea5fe2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:33:02 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-fed8d753-7edc-4b39-a4fd-85a5759dde44 tempest-VolumesActionsTest-1452873777 None] Created volume successfully. Feb 26 20:33:12 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:33:12 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:33:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b16bc20b-dd91-4eeb-950c-3e5616fc216a tempest-VolumesActionsTest-1452873777 None] Acquiring lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" by "attach_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:33:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b16bc20b-dd91-4eeb-950c-3e5616fc216a tempest-VolumesActionsTest-1452873777 None] Lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" acquired by "attach_volume" :: waited 0.016s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:33:17 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b16bc20b-dd91-4eeb-950c-3e5616fc216a tempest-VolumesActionsTest-1452873777 None] Attaching volume 7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 to instance 973c18ea-8d1f-416a-925a-b124f4348005 at mountpoint /dev/vdb on host None. Feb 26 20:33:17 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b16bc20b-dd91-4eeb-950c-3e5616fc216a tempest-VolumesActionsTest-1452873777 None] Attach volume completed successfully. Feb 26 20:33:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-b16bc20b-dd91-4eeb-950c-3e5616fc216a tempest-VolumesActionsTest-1452873777 None] Lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" released by "attach_volume" :: held 0.066s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:33:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6e800a8b-c045-407c-b0e7-c1d7a08252ac tempest-VolumesActionsTest-1452873777 None] Acquiring lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5-detach_volume" by "detach_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:33:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6e800a8b-c045-407c-b0e7-c1d7a08252ac tempest-VolumesActionsTest-1452873777 None] Lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:33:18 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-6e800a8b-c045-407c-b0e7-c1d7a08252ac tempest-VolumesActionsTest-1452873777 None] Detaching volume 7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 from instance 973c18ea-8d1f-416a-925a-b124f4348005. Feb 26 20:33:18 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-6e800a8b-c045-407c-b0e7-c1d7a08252ac tempest-VolumesActionsTest-1452873777 None] Detach volume completed successfully. Feb 26 20:33:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6e800a8b-c045-407c-b0e7-c1d7a08252ac tempest-VolumesActionsTest-1452873777 None] Lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:33:24 devstack cinder-volume[83352]: DEBUG oslo_service.periodic_task [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83352) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:33:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:33:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:33:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:33:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:33:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:33:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:33:24 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:33:24 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:33:24 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Feb 26 20:33:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.503s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:33:24 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:33:28 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:33:28 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:33:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-84171b85-4e4c-465d-99fc-5185e651da2f tempest-VolumesActionsTest-1452873777 None] Acquiring lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" by "attach_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:33:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-84171b85-4e4c-465d-99fc-5185e651da2f tempest-VolumesActionsTest-1452873777 None] Lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" acquired by "attach_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:33:38 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-84171b85-4e4c-465d-99fc-5185e651da2f tempest-VolumesActionsTest-1452873777 None] Attaching volume 7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 to instance 45b69779-f953-4e68-97c8-9116c5ec213f at mountpoint /dev/vdb on host None. Feb 26 20:33:38 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-84171b85-4e4c-465d-99fc-5185e651da2f tempest-VolumesActionsTest-1452873777 None] Attach volume completed successfully. Feb 26 20:33:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-84171b85-4e4c-465d-99fc-5185e651da2f tempest-VolumesActionsTest-1452873777 None] Lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" released by "attach_volume" :: held 0.090s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:33:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-28a62c17-208b-441a-a5d0-e01cdcc95dcf tempest-VolumesActionsTest-1452873777 None] Acquiring lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5-detach_volume" by "detach_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:33:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-28a62c17-208b-441a-a5d0-e01cdcc95dcf tempest-VolumesActionsTest-1452873777 None] Lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:33:39 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-28a62c17-208b-441a-a5d0-e01cdcc95dcf tempest-VolumesActionsTest-1452873777 None] Detaching volume 7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 from instance 45b69779-f953-4e68-97c8-9116c5ec213f. Feb 26 20:33:39 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-28a62c17-208b-441a-a5d0-e01cdcc95dcf tempest-VolumesActionsTest-1452873777 None] Detach volume completed successfully. Feb 26 20:33:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-28a62c17-208b-441a-a5d0-e01cdcc95dcf tempest-VolumesActionsTest-1452873777 None] Lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:33:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:33:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:33:48 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[df41d4d4-73f6-4ac3-86e7-8fe65121d21b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:33:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:33:48 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 Feb 26 20:33:48 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:33:49 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Feb 26 20:33:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" returned: 0 in 0.551s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:33:49 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa960c61-ce79-4690-82e9-9364b1d1d99b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:33:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:33:49 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 Feb 26 20:33:49 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:33:49 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=2 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:33:49 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Feb 26 20:33:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" returned: 0 in 0.599s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:33:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.ecc3d5ec-519d-474b-9f50-7e4db1ad886c_nv3zorv.img {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:33:49 devstack sudo[90229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.ecc3d5ec-519d-474b-9f50-7e4db1ad886c_nv3zorv.img Feb 26 20:33:49 devstack sudo[90229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:33:51 devstack sudo[90229]: pam_unix(sudo:session): session closed for user root Feb 26 20:33:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.ecc3d5ec-519d-474b-9f50-7e4db1ad886c_nv3zorv.img" returned: 0 in 2.151s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:33:51 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ca435a-04cf-4de2-8475-5230286b297e]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:33:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:33:51 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 Feb 26 20:33:51 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:33:52 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Feb 26 20:33:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" returned: 0 in 0.620s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:33:52 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.ecc3d5ec-519d-474b-9f50-7e4db1ad886c_nv3zorv.img {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:33:52 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] Converted 1024.00 MB image at 475.88 MB/s Feb 26 20:33:52 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] ecc3d5ec-519d-474b-9f50-7e4db1ad886c was raw, no need to convert to raw {{(pid=83352) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Feb 26 20:34:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.793s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] Uploaded volume to glance image-id: ecc3d5ec-519d-474b-9f50-7e4db1ad886c. {{(pid=83352) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 26 20:34:02 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-74d4ce1a-1d7b-4bc7-9bb9-db863ba30be7 tempest-VolumesActionsTest-1452873777 None] Copy volume to image completed successfully. Feb 26 20:34:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:03 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[7468392a-8abd-42b7-9db4-b40ac2d07612]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:03 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 Feb 26 20:34:03 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:04 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" returned: 0 in 0.532s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:04 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23d6197-4a0e-4a5f-ad68-fada573fc683]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:04 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 Feb 26 20:34:04 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:04 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" returned: 0 in 0.526s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:04 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img Feb 26 20:34:04 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:06 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img" returned: 0 in 2.204s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:06 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c0eedc-1839-4b9f-a405-fe8f732a8464]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:06 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 Feb 26 20:34:06 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:07 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" returned: 0 in 0.700s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:07 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:34:07 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Converted 1024.00 MB image at 464.25 MB/s Feb 26 20:34:07 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] 927f30e4-af18-442b-85bf-cae0eda9e2ad was raw, converting to qcow2 {{(pid=83352) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Feb 26 20:34:07 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7e6c61-6c55-47fc-ae3f-b8dc36830150]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:07 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img Feb 26 20:34:07 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:08 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img" returned: 0 in 0.503s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:08 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img Feb 26 20:34:08 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:08 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img" returned: 1 in 0.480s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:34:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img /opt/stack/data/cinder/conversion/vol_upload_u8o317qc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:08 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img /opt/stack/data/cinder/conversion/vol_upload_u8o317qc Feb 26 20:34:08 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:09 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img /opt/stack/data/cinder/conversion/vol_upload_u8o317qc" returned: 0 in 0.421s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:09 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Image conversion details: src /opt/stack/data/cinder/conversion/7b9be230-b62e-4f75-a3ec-2ca80ced6eb5.temp_image.927f30e4-af18-442b-85bf-cae0eda9e2adwmnf_tld.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_u8o317qc {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:34:09 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Converted 1024.00 MB image at 1024.00 MB/s Feb 26 20:34:09 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b957aaf8-7f20-4bf7-983b-8f852b3b19cb]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8o317qc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:09 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8o317qc Feb 26 20:34:09 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:09 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8o317qc" returned: 0 in 0.459s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 7.103s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Uploaded volume to glance image-id: 927f30e4-af18-442b-85bf-cae0eda9e2ad. {{(pid=83352) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Feb 26 20:34:10 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-03a4c80a-37ea-47c8-93ca-88f3ec356868 tempest-VolumesActionsTest-1452873777 None] Copy volume to image completed successfully. Feb 26 20:34:11 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Acquiring lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:11 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:11 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Acquiring lock "cinder-quobyte-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:11 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Lock "cinder-quobyte-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:11 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[baeb8136-b069-4505-8fc4-8def2f3c1776]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:11 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 Feb 26 20:34:11 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:11 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" returned: 0 in 0.514s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:11 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5 Feb 26 20:34:11 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:12 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" returned: 0 in 0.450s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:12 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Lock "cinder-quobyte-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5" released by "delete_volume" :: held 1.006s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:12 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Created reservations ['16fc4b67-bcc8-45ec-9e56-361587577a94', '104c6c7b-8da2-4be8-91a7-c5b3eba4cc42', '89b16125-8cae-465b-855e-ce5caf54910e', '78fff362-5e98-4781-b8ab-1652601e28a7'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:34:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:12 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:34:12 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:13 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.498s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:13 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:34:13 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Deleted volume successfully. Feb 26 20:34:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-f95629f4-bd60-4816-840c-c433407f557d tempest-VolumesActionsTest-1452873777 None] Lock "cinder-7b9be230-b62e-4f75-a3ec-2ca80ced6eb5-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (b16c8dc9-a103-4050-8924-2fd4423f6a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8b87ba-67bf-4e73-9cff-ebfce8ba83e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f8b87ba-67bf-4e73-9cff-ebfce8ba83e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1951039950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:19Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ea1e63-b90e-4ca2-a375-6af60d8a9ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ea1e63-b90e-4ca2-a375-6af60d8a9ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bada9a4e-1b0a-4feb-9079-7e2f2f185138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bada9a4e-1b0a-4feb-9079-7e2f2f185138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f', 'volume_name': 'volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0f532e-3844-45df-9ca2-ade4328d79f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f0f532e-3844-45df-9ca2-ade4328d79f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c27bc01-a916-463c-8620-7ac7199f97d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:19 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Volume 61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f', 'volume_size': 1} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1951039950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:19Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Creating volume 61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:34:19 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:19 devstack sudo[90313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f 1073741824 Feb 26 20:34:19 devstack sudo[90313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:19 devstack sudo[90313]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f 1073741824" returned: 0 in 0.556s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:19 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f Feb 26 20:34:19 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:20 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f" returned: 0 in 0.443s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:34:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c27bc01-a916-463c-8620-7ac7199f97d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84b84d3-7f93-4ad0-8fa7-f19b294d6988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:20 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Volume volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f (61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f): created successfully Feb 26 20:34:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84b84d3-7f93-4ad0-8fa7-f19b294d6988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:20 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (b16c8dc9-a103-4050-8924-2fd4423f6a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:20 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-20fd7849-e8ac-48f1-9391-280e43c40aea tempest-VolumesGetTest-667622813 None] Created volume successfully. Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (dde77eb5-34b9-4a90-9d03-9bf15e3c4d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e545ce82-38dc-4a86-8529-24296e1e08c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e545ce82-38dc-4a86-8529-24296e1e08c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1898060479',display_name='tempest-VolumesGetTest-Volume-1654213754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53405c3f-66db-453e-ad01-75d95456347b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:22Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6d4ddc-9f6c-477c-94f1-8357295b5fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6d4ddc-9f6c-477c-94f1-8357295b5fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e225b4-f370-4733-84ae-a36801b82eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e225b4-f370-4733-84ae-a36801b82eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53405c3f-66db-453e-ad01-75d95456347b', 'volume_name': 'volume-53405c3f-66db-453e-ad01-75d95456347b', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e38313-415f-403f-943b-3535b91dce81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e38313-415f-403f-943b-3535b91dce81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede9701c-8b01-4f65-a874-362612ec994c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:21 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Volume 53405c3f-66db-453e-ad01-75d95456347b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53405c3f-66db-453e-ad01-75d95456347b', 'volume_size': 1} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1898060479',display_name='tempest-VolumesGetTest-Volume-1654213754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53405c3f-66db-453e-ad01-75d95456347b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:22Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Creating volume 53405c3f-66db-453e-ad01-75d95456347b {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:34:21 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:34:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-53405c3f-66db-453e-ad01-75d95456347b 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:21 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-53405c3f-66db-453e-ad01-75d95456347b 1073741824 Feb 26 20:34:21 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:22 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-53405c3f-66db-453e-ad01-75d95456347b 1073741824" returned: 0 in 0.564s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-53405c3f-66db-453e-ad01-75d95456347b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:22 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-53405c3f-66db-453e-ad01-75d95456347b Feb 26 20:34:22 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:22 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-53405c3f-66db-453e-ad01-75d95456347b" returned: 0 in 0.489s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:34:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:22 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede9701c-8b01-4f65-a874-362612ec994c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53405c3f-66db-453e-ad01-75d95456347b', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:22 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16009382-e2cb-48e6-809f-d10adeb29917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:22 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Volume volume-53405c3f-66db-453e-ad01-75d95456347b (53405c3f-66db-453e-ad01-75d95456347b): created successfully Feb 26 20:34:22 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16009382-e2cb-48e6-809f-d10adeb29917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:22 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (dde77eb5-34b9-4a90-9d03-9bf15e3c4d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:22 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-124ae560-aaaa-4bbb-8f9e-346ea5283e0d tempest-VolumesGetTest-667622813 None] Created volume successfully. Feb 26 20:34:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-53405c3f-66db-453e-ad01-75d95456347b-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Lock "cinder-53405c3f-66db-453e-ad01-75d95456347b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-quobyte-53405c3f-66db-453e-ad01-75d95456347b" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-53405c3f-66db-453e-ad01-75d95456347b" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:23 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66fa699-324d-4abc-8b19-2f7fc09258da]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-53405c3f-66db-453e-ad01-75d95456347b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:24 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-53405c3f-66db-453e-ad01-75d95456347b Feb 26 20:34:24 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG oslo_service.periodic_task [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83352) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:24 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:34:24 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:24 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-53405c3f-66db-453e-ad01-75d95456347b" returned: 0 in 0.494s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-53405c3f-66db-453e-ad01-75d95456347b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:24 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-53405c3f-66db-453e-ad01-75d95456347b Feb 26 20:34:24 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:24 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.441s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:34:24 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-53405c3f-66db-453e-ad01-75d95456347b" returned: 0 in 0.447s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-53405c3f-66db-453e-ad01-75d95456347b" released by "delete_volume" :: held 0.965s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:24 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Created reservations ['6ca64d7f-65c6-439d-9166-2e992f8d86af', 'f165b158-3868-426c-9a1c-6c9b46712a27', '02028b9c-8d80-411f-9a4c-9be8793992ee', '83a5877d-e87b-4b17-9218-cfa6946425c7'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:25 devstack sudo[90341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:34:25 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Lock "cinder-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-quobyte-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f37ecf-5db0-4556-af04-4a7f26ccdd9b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:25 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f Feb 26 20:34:25 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:25 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.457s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:34:25 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Deleted volume successfully. Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ca27f879-c3cb-4f01-87f0-9179c9c4845b tempest-VolumesGetTest-667622813 None] Lock "cinder-53405c3f-66db-453e-ad01-75d95456347b-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:25 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f" returned: 0 in 0.490s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:25 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f Feb 26 20:34:25 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:26 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f" returned: 0 in 0.404s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f" released by "delete_volume" :: held 0.930s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Created reservations ['ac5fd203-65fc-473b-a010-9ddb7ede600b', 'db38f630-0e83-40ea-946f-2c7b26542b12', 'de5aa53e-4dc8-4113-9c6d-ca3186289c9d', '68435b4e-da8c-4e62-bdb4-51c1f8246af3'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:26 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:34:26 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (14f6f6aa-8702-4acd-a98a-aab01ad9145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52073f96-a5d3-442b-b919-0ca46cbe8c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52073f96-a5d3-442b-b919-0ca46cbe8c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-49547424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a781b6c5-6f89-4024-a689-ea6c2d8ca4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:27Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374099af-19b2-45ad-8747-b643b7a62a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374099af-19b2-45ad-8747-b643b7a62a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23fff5ab-ab14-4736-952b-c3512a5b0535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23fff5ab-ab14-4736-952b-c3512a5b0535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a781b6c5-6f89-4024-a689-ea6c2d8ca4fc', 'volume_name': 'volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9053e06c-3dc1-480a-a484-dd87461ff25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9053e06c-3dc1-480a-a484-dd87461ff25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09565200-58e7-4f16-aabe-30c831e07834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:26 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Volume a781b6c5-6f89-4024-a689-ea6c2d8ca4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc', 'volume_size': 1} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-49547424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a781b6c5-6f89-4024-a689-ea6c2d8ca4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:27Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Creating volume a781b6c5-6f89-4024-a689-ea6c2d8ca4fc {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:34:26 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:26 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc 1073741824 Feb 26 20:34:26 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:26 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.500s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:34:26 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Deleted volume successfully. Feb 26 20:34:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8dbda524-ee28-4f83-9724-fe67809ebd78 tempest-VolumesGetTest-667622813 None] Lock "cinder-61ceaa1d-a60d-4fdb-8749-6c6e3db11a4f-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:27 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc 1073741824" returned: 0 in 0.519s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:27 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc Feb 26 20:34:27 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:27 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc" returned: 0 in 0.435s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:34:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09565200-58e7-4f16-aabe-30c831e07834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34c2dcd-b6eb-4e65-b51e-e1ac4d3de7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:27 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Volume volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc (a781b6c5-6f89-4024-a689-ea6c2d8ca4fc): created successfully Feb 26 20:34:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34c2dcd-b6eb-4e65-b51e-e1ac4d3de7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (14f6f6aa-8702-4acd-a98a-aab01ad9145c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:27 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b677b105-4d8e-4080-ba65-0662d3fbfee8 tempest-VolumesGetTest-667622813 None] Created volume successfully. Feb 26 20:34:28 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (363ab205-ebd9-413d-8913-3934bd80feab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e624f2-a47e-4872-b8a5-b3c58d66ce08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5e624f2-a47e-4872-b8a5-b3c58d66ce08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1429179335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a781b6c5-6f89-4024-a689-ea6c2d8ca4fc,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:29Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3637f5-db30-4ab2-b939-6f31e0012e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3637f5-db30-4ab2-b939-6f31e0012e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6c3afa-40b9-4cb8-91f0-00654bcacba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6c3afa-40b9-4cb8-91f0-00654bcacba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98', 'volume_name': 'volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98', 'volume_size': 1, 'source_volid': 'a781b6c5-6f89-4024-a689-ea6c2d8ca4fc', 'source_volstatus': 'available'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f08db8-df5b-4bec-8eaa-3025ace5704b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f08db8-df5b-4bec-8eaa-3025ace5704b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ab8f4e-87e5-4635-8d27-f687e9aba6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:29 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Volume a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98', 'volume_size': 1, 'source_volid': 'a781b6c5-6f89-4024-a689-ea6c2d8ca4fc', 'source_volstatus': 'available'} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:29 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Cloning volume a781b6c5-6f89-4024-a689-ea6c2d8ca4fc to volume a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Creating offline snapshot ff654992-400c-49d3-809b-3347a111785a of volume a781b6c5-6f89-4024-a689-ea6c2d8ca4fc {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c4abb6-9c5e-4f84-9dc3-12f55f03fb5d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:29 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc Feb 26 20:34:29 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:29 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc" returned: 0 in 0.487s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:29 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a 1G Feb 26 20:34:29 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:30 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a 1G" returned: 0 in 0.531s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:30 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a Feb 26 20:34:30 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:30 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a" returned: 0 in 0.447s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:30 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a is being set with open permissions: ugo+rw Feb 26 20:34:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:30 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a Feb 26 20:34:30 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:31 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a" returned: 0 in 0.404s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:31 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.info Feb 26 20:34:31 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:31 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.info" returned: 0 in 0.429s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:31 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.info is being set with open permissions: ugo+rw Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:31 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.info Feb 26 20:34:31 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:31 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.info" returned: 0 in 0.428s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-quobyte-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98" by "_copy_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] snapshot: ff654992-400c-49d3-809b-3347a111785a, volume: a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98, {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7fe088-361f-4d7b-8a8e-81d0f9b4bcb0]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:32 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a Feb 26 20:34:32 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:32 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a" returned: 0 in 0.560s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:34:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 20:34:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Creating direct copy from snapshot {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 20:34:32 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2986c1-2b6c-42a2-90d2-0b6cdb24d18d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:32 devstack sudo[90393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc Feb 26 20:34:32 devstack sudo[90393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:33 devstack sudo[90393]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc" returned: 0 in 0.563s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:33 devstack cinder-volume[83352]: DEBUG cinder.utils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Path /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 not found in is_blk_device check {{(pid=83352) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 20:34:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:33 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 Feb 26 20:34:33 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:35 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98" returned: 0 in 2.232s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:35 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c51bf4-1a25-45a2-ab07-33981d8b589f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:35 devstack sudo[90410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc Feb 26 20:34:35 devstack sudo[90410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:35 devstack sudo[90410]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc" returned: 0 in 0.613s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:35 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:34:35 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Converted 1024.00 MB image at 458.41 MB/s Feb 26 20:34:35 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 is being set with open permissions: ugo+rw Feb 26 20:34:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:35 devstack sudo[90415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 Feb 26 20:34:35 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:36 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98" returned: 0 in 0.444s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:36 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98" released by "_copy_volume_from_snapshot" :: held 4.469s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:36 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-quobyte-ff654992-400c-49d3-809b-3347a111785a" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:36 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-ff654992-400c-49d3-809b-3347a111785a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Deleting offline snapshot ff654992-400c-49d3-809b-3347a111785a of volume a781b6c5-6f89-4024-a689-ea6c2d8ca4fc {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:34:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] snapshot_file for this snap is: volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:34:36 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92cd529-084e-457c-9ae6-34f4ef95fa88]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:36 devstack sudo[90418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a Feb 26 20:34:36 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:36 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a" returned: 0 in 0.506s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:34:36 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d19edb9-e4b3-4349-b7ca-7b25b7acf1fd]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:37 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc Feb 26 20:34:37 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:37 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc" returned: 0 in 0.513s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:37 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a Feb 26 20:34:37 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:37 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a" returned: 0 in 0.518s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:38 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a Feb 26 20:34:38 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:38 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc.ff654992-400c-49d3-809b-3347a111785a" returned: 0 in 0.435s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-ff654992-400c-49d3-809b-3347a111785a" released by "_delete_snapshot" :: held 2.033s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:38 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=35,cinder:INSERT=8,cinder:UPDATE=36,cinder:DELETE=4 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:34:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.387s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ab8f4e-87e5-4635-8d27-f687e9aba6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98', 'volume_size': 1, 'source_volid': 'a781b6c5-6f89-4024-a689-ea6c2d8ca4fc', 'source_volstatus': 'available'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3006a542-2989-47e0-b516-29243ce7cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:38 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Volume volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 (a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98): created successfully Feb 26 20:34:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3006a542-2989-47e0-b516-29243ce7cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:38 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (363ab205-ebd9-413d-8913-3934bd80feab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:38 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0cd93139-a684-4b39-921c-748e44bfb306 tempest-VolumesGetTest-667622813 None] Created volume successfully. Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (d5115989-97a3-4af9-8fb8-e9b694845856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8767642-209c-43bd-aa42-34ab0399af01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8767642-209c-43bd-aa42-34ab0399af01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1963018213',display_name='tempest-VolumesGetTest-Volume-1562223399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f534ce-b1ce-4038-aac0-503c6cf0c193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:40Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6512f05-462c-4f92-bed0-6c3804baf211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6512f05-462c-4f92-bed0-6c3804baf211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9647fc4-eb5f-4f71-ae59-cf6414f4bad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9647fc4-eb5f-4f71-ae59-cf6414f4bad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f534ce-b1ce-4038-aac0-503c6cf0c193', 'volume_name': 'volume-28f534ce-b1ce-4038-aac0-503c6cf0c193', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc88119-5eb7-4554-86e5-7ecfcc43d1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc88119-5eb7-4554-86e5-7ecfcc43d1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746e6d18-e137-4a70-b29e-f720a479b45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:40 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Volume 28f534ce-b1ce-4038-aac0-503c6cf0c193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f534ce-b1ce-4038-aac0-503c6cf0c193', 'volume_size': 1} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1963018213',display_name='tempest-VolumesGetTest-Volume-1562223399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f534ce-b1ce-4038-aac0-503c6cf0c193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:40Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Creating volume 28f534ce-b1ce-4038-aac0-503c6cf0c193 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:34:40 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28f534ce-b1ce-4038-aac0-503c6cf0c193 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:40 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28f534ce-b1ce-4038-aac0-503c6cf0c193 1073741824 Feb 26 20:34:40 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:40 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28f534ce-b1ce-4038-aac0-503c6cf0c193 1073741824" returned: 0 in 0.561s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28f534ce-b1ce-4038-aac0-503c6cf0c193 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:40 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28f534ce-b1ce-4038-aac0-503c6cf0c193 Feb 26 20:34:40 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:41 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28f534ce-b1ce-4038-aac0-503c6cf0c193" returned: 0 in 0.457s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:34:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746e6d18-e137-4a70-b29e-f720a479b45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f534ce-b1ce-4038-aac0-503c6cf0c193', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b30ca54-0344-42a2-bb67-6913db46ae88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:41 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Volume volume-28f534ce-b1ce-4038-aac0-503c6cf0c193 (28f534ce-b1ce-4038-aac0-503c6cf0c193): created successfully Feb 26 20:34:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b30ca54-0344-42a2-bb67-6913db46ae88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:41 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (d5115989-97a3-4af9-8fb8-e9b694845856) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:41 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d971ff64-3df2-4f1a-b1e4-b91ba978bf59 tempest-VolumesGetTest-667622813 None] Created volume successfully. Feb 26 20:34:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-28f534ce-b1ce-4038-aac0-503c6cf0c193-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Lock "cinder-28f534ce-b1ce-4038-aac0-503c6cf0c193-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-quobyte-28f534ce-b1ce-4038-aac0-503c6cf0c193" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-28f534ce-b1ce-4038-aac0-503c6cf0c193" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:42 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[991f4449-f04b-497b-82bf-d6749656e0e1]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28f534ce-b1ce-4038-aac0-503c6cf0c193 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:42 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28f534ce-b1ce-4038-aac0-503c6cf0c193 Feb 26 20:34:42 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:43 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28f534ce-b1ce-4038-aac0-503c6cf0c193" returned: 0 in 0.539s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28f534ce-b1ce-4038-aac0-503c6cf0c193 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:43 devstack sudo[90456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28f534ce-b1ce-4038-aac0-503c6cf0c193 Feb 26 20:34:43 devstack sudo[90456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:43 devstack sudo[90456]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-28f534ce-b1ce-4038-aac0-503c6cf0c193" returned: 0 in 0.554s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-28f534ce-b1ce-4038-aac0-503c6cf0c193" released by "delete_volume" :: held 1.118s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:43 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Created reservations ['f6e17d2d-4c8e-4712-ad24-19e1b4b508b9', 'd0de4606-cf17-4d4f-877e-5339acfae27c', '8ce77a84-3ddc-45c7-bc4b-03113d135838', '0818fdbb-dbf5-4bd0-a5c7-da1d5071a8c2'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:34:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:43 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:34:43 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:44 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.456s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:44 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:34:44 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Deleted volume successfully. Feb 26 20:34:44 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-5091fc07-bc1b-4b13-9d31-17c0a7ec1086 tempest-VolumesGetTest-667622813 None] Lock "cinder-28f534ce-b1ce-4038-aac0-503c6cf0c193-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:44 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:44 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Lock "cinder-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:44 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-quobyte-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:44 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:44 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8273082-9fb4-4e86-a112-1726c8af7535]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:44 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 Feb 26 20:34:44 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:45 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98" returned: 0 in 0.550s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:45 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98 Feb 26 20:34:45 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:45 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98" returned: 0 in 0.456s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98" released by "delete_volume" :: held 1.033s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:45 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Created reservations ['9c1f0492-5cd6-47aa-b584-87767f5d445c', 'ec79779a-e6d8-4a30-996e-c198c8f4fc54', '4c0da58d-79e4-4539-b4fe-6f09e546d88d', 'e98a2634-97f4-480f-825a-d2df6a8a0759'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:34:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:45 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:34:45 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:46 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.476s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:46 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:34:46 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Deleted volume successfully. Feb 26 20:34:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-03c336cb-3b51-45e9-a2a0-d6e8016ef957 tempest-VolumesGetTest-667622813 None] Lock "cinder-a36ccbc5-3f4c-41ba-96fe-c1fdfdbfff98-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Lock "cinder-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:46 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-quobyte-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:47 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9de928-22ca-4409-88bb-47293b13cf79]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:47 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc Feb 26 20:34:47 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:47 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc" returned: 0 in 0.567s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:47 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc Feb 26 20:34:47 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:48 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc" returned: 0 in 0.491s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc" released by "delete_volume" :: held 1.101s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:48 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Created reservations ['750350cf-8d3c-4430-85ef-ffa504d535af', 'f81a6f78-6154-4580-ae85-4f5174086351', '0380abab-4e6d-4e66-80c4-e0424450e307', '1d89cda6-2951-4f91-a4e8-d1e181f48d0c'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:34:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:48 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:34:48 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:48 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.446s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:48 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:34:48 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Deleted volume successfully. Feb 26 20:34:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c2de8f8c-ffe6-4c48-98e3-c389dc09774c tempest-VolumesGetTest-667622813 None] Lock "cinder-a781b6c5-6f89-4024-a689-ea6c2d8ca4fc-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=50,cinder:UPDATE=72,cinder:INSERT=17,cinder:DELETE=6 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (8bde7c71-da73-4676-b390-6cec1e22f643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573e0dc5-8a1e-4609-b6f4-4e974d83dc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573e0dc5-8a1e-4609-b6f4-4e974d83dc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-349475553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a221532b-34c1-4689-bf19-908ac6f8a5c0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:50Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52fd6b1-d5af-4402-b5f1-fd0c02a98063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52fd6b1-d5af-4402-b5f1-fd0c02a98063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a338b4e-3f2a-4e81-bf95-3b4b89b7f500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.image.glance [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Creating Keystone auth plugin from conf {{(pid=83352) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a338b4e-3f2a-4e81-bf95-3b4b89b7f500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a221532b-34c1-4689-bf19-908ac6f8a5c0', 'volume_name': 'volume-a221532b-34c1-4689-bf19-908ac6f8a5c0', 'volume_size': 1, 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9cc93d85d98d418bb1b53f2c8bbda0ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'created_at': datetime.datetime(2026, 2, 26, 19, 20, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 19, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdff699-c513-47ad-a243-08747618d646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bdff699-c513-47ad-a243-08747618d646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b4aa47-8bb1-4d93-bfa6-d898c7c73ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:49 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Volume a221532b-34c1-4689-bf19-908ac6f8a5c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a221532b-34c1-4689-bf19-908ac6f8a5c0', 'volume_size': 1, 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9cc93d85d98d418bb1b53f2c8bbda0ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'created_at': datetime.datetime(2026, 2, 26, 19, 20, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 19, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Feb 26 20:34:49 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Trying to clone a221532b-34c1-4689-bf19-908ac6f8a5c0 from image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]). {{(pid=83352) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Feb 26 20:34:50 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83352) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Feb 26 20:34:50 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Image download 20.69 MB at 20.69 MB/s Feb 26 20:34:50 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e4ba12-7500-4694-a24c-aba387b8a17c]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:50 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD Feb 26 20:34:50 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:50 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD" returned: 0 in 0.500s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:50 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Temporary image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 is fetched for user 8851a10ca156498e922d52b475f150d0. {{(pid=83352) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Feb 26 20:34:50 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[95383715-f995-467a-8264-dd1e45369373]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:50 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD Feb 26 20:34:50 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:51 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-349475553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a221532b-34c1-4689-bf19-908ac6f8a5c0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:50Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Creating volume a221532b-34c1-4689-bf19-908ac6f8a5c0 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:34:51 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:51 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 1073741824 Feb 26 20:34:51 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:51 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 1073741824" returned: 0 in 0.579s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:51 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 Feb 26 20:34:51 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:52 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0" returned: 0 in 0.429s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:34:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:52 devstack cinder-volume[83352]: DEBUG cinder.volume.volume_utils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Attempting download of 8dcf692b-f75b-4a29-963c-f59ebe841cf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}])) to volume a221532b-34c1-4689-bf19-908ac6f8a5c0. {{(pid=83352) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Feb 26 20:34:52 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b87118-233a-426b-a380-b91dbbc1ddf5]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_r7n36znu {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:52 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_r7n36znu Feb 26 20:34:52 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:52 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_r7n36znu" returned: 0 in 0.452s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_r7n36znu {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:52 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_r7n36znu Feb 26 20:34:52 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:53 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_r7n36znu" returned: 1 in 0.442s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8dcf692b-f75b-4a29-963c-f59ebe841cf3_r7n36znu' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:34:53 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa01198c-44cd-4428-b288-cf3b2d6b7d93]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:53 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD Feb 26 20:34:53 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:53 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD" returned: 0 in 0.478s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:53 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] 8dcf692b-f75b-4a29-963c-f59ebe841cf3 was qcow2, converting to raw {{(pid=83352) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Feb 26 20:34:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:53 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 Feb 26 20:34:53 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:54 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0" returned: 0 in 1.016s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:54 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8dcf692b-f75b-4a29-963c-f59ebe841cf3_wjoizv52devstack@QuobyteHD, size 112.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:34:54 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Converted 112.00 MB image at 110.09 MB/s Feb 26 20:34:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:54 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 1G Feb 26 20:34:54 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:55 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 1G" returned: 0 in 0.456s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:55 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6ef4bf-f99d-4c45-a389-a1cf2f7ddb7d]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:55 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 Feb 26 20:34:55 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:55 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0" returned: 0 in 0.497s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:55 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 Feb 26 20:34:55 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:56 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0" returned: 1 in 0.491s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:34:56 devstack cinder-volume[83352]: DEBUG cinder.volume.volume_utils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Downloaded image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 ((None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}])) to volume a221532b-34c1-4689-bf19-908ac6f8a5c0 successfully. {{(pid=83352) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Feb 26 20:34:56 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Temporary image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 for user 8851a10ca156498e922d52b475f150d0 is deleted. {{(pid=83352) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Feb 26 20:34:56 devstack cinder-volume[83352]: DEBUG cinder.volume.volume_utils [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Marking volume a221532b-34c1-4689-bf19-908ac6f8a5c0 as bootable. {{(pid=83352) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Feb 26 20:34:56 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Copying metadata from image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 to a221532b-34c1-4689-bf19-908ac6f8a5c0. {{(pid=83352) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Feb 26 20:34:56 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Creating volume glance metadata for volume a221532b-34c1-4689-bf19-908ac6f8a5c0 backed by image 8dcf692b-f75b-4a29-963c-f59ebe841cf3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83352) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Feb 26 20:34:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b4aa47-8bb1-4d93-bfa6-d898c7c73ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a221532b-34c1-4689-bf19-908ac6f8a5c0', 'volume_size': 1, 'image_id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9cc93d85d98d418bb1b53f2c8bbda0ca', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8dcf692b-f75b-4a29-963c-f59ebe841cf3', 'created_at': datetime.datetime(2026, 2, 26, 19, 20, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 2, 26, 19, 20, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8dcf692b-f75b-4a29-963c-f59ebe841cf3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7cacf89-3b03-4691-b1eb-3217be6cf25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:56 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Volume volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 (a221532b-34c1-4689-bf19-908ac6f8a5c0): created successfully Feb 26 20:34:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7cacf89-3b03-4691-b1eb-3217be6cf25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (8bde7c71-da73-4676-b390-6cec1e22f643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:56 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-730964b8-211c-4a52-99f5-51ff5a0c4ed7 tempest-VolumesGetTest-667622813 None] Created volume successfully. Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (603d240a-611c-4a56-aeb4-7ddaf7599868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71a8443-7b47-413c-a27c-ffbe8bd8546c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71a8443-7b47-413c-a27c-ffbe8bd8546c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-679692572',display_name='tempest-VolumesGetTest-Volume-545421806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e758c0b-a5c7-49a5-a961-d1d777f48d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:57Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d77669b-d497-4674-a5ac-b8dc10c7efe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d77669b-d497-4674-a5ac-b8dc10c7efe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb5e0a5-db50-466b-8e6b-63b28a174b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb5e0a5-db50-466b-8e6b-63b28a174b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e758c0b-a5c7-49a5-a961-d1d777f48d87', 'volume_name': 'volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de70eda5-2096-4eb5-b876-a0eafd44a7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de70eda5-2096-4eb5-b876-a0eafd44a7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a481b3-acd1-465d-ac1a-ddc46ffc3861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:57 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Volume 1e758c0b-a5c7-49a5-a961-d1d777f48d87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87', 'volume_size': 1} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:34:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-679692572',display_name='tempest-VolumesGetTest-Volume-545421806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e758c0b-a5c7-49a5-a961-d1d777f48d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9022b311ef472fbc99b83c4ab4be79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:34:57Z,use_quota=True,user_id='8851a10ca156498e922d52b475f150d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Creating volume 1e758c0b-a5c7-49a5-a961-d1d777f48d87 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:34:57 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:34:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:57 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87 1073741824 Feb 26 20:34:57 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:58 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87 1073741824" returned: 0 in 0.597s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:58 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87 Feb 26 20:34:58 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:34:58 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Feb 26 20:34:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87" returned: 0 in 0.459s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:34:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:34:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:34:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a481b3-acd1-465d-ac1a-ddc46ffc3861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c641db5-9464-4a6f-806d-8dd2f314ee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:34:58 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Volume volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87 (1e758c0b-a5c7-49a5-a961-d1d777f48d87): created successfully Feb 26 20:34:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c641db5-9464-4a6f-806d-8dd2f314ee8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:34:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Flow 'volume_create_manager' (603d240a-611c-4a56-aeb4-7ddaf7599868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:34:58 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-bdbbfd64-a0ab-483b-9b0d-38cee088445d tempest-VolumesGetTest-667622813 None] Created volume successfully. Feb 26 20:34:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-1e758c0b-a5c7-49a5-a961-d1d777f48d87-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Lock "cinder-1e758c0b-a5c7-49a5-a961-d1d777f48d87-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-quobyte-1e758c0b-a5c7-49a5-a961-d1d777f48d87" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:34:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-1e758c0b-a5c7-49a5-a961-d1d777f48d87" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:34:59 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62ec74c-2882-483e-a39e-d3bb6742cda3]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:34:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:34:59 devstack sudo[90589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87 Feb 26 20:34:59 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:00 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87" returned: 0 in 0.558s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:00 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87 Feb 26 20:35:00 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:00 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-1e758c0b-a5c7-49a5-a961-d1d777f48d87" returned: 0 in 0.490s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-1e758c0b-a5c7-49a5-a961-d1d777f48d87" released by "delete_volume" :: held 1.087s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:00 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Created reservations ['7212a609-8ca9-4807-884e-f97c1dd97de0', 'd168bac6-c047-4b45-9208-b9dcf22647a9', '7db8f6fe-d4f4-4da2-a6e7-99919b126487', '7b85e65b-4764-4183-a282-bbc8c8ed3965'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:35:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:01 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:35:01 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:01 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.519s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:01 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:35:01 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Deleted volume successfully. Feb 26 20:35:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c7fac946-8c2f-41ab-9bf0-69601887a65e tempest-VolumesGetTest-667622813 None] Lock "cinder-1e758c0b-a5c7-49a5-a961-d1d777f48d87-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-a221532b-34c1-4689-bf19-908ac6f8a5c0-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Lock "cinder-a221532b-34c1-4689-bf19-908ac6f8a5c0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Acquiring lock "cinder-quobyte-a221532b-34c1-4689-bf19-908ac6f8a5c0" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-a221532b-34c1-4689-bf19-908ac6f8a5c0" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:02 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b9d2e9-b40a-4413-b03d-f89da9ca4561]: (4, 'raw') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:02 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 Feb 26 20:35:02 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:02 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0" returned: 0 in 0.496s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:02 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 Feb 26 20:35:02 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:03 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0" returned: 1 in 0.503s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0' failed. Not Retrying. {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Feb 26 20:35:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:03 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0 Feb 26 20:35:03 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:03 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a221532b-34c1-4689-bf19-908ac6f8a5c0" returned: 0 in 0.439s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Lock "cinder-quobyte-a221532b-34c1-4689-bf19-908ac6f8a5c0" released by "delete_volume" :: held 1.482s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:03 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Created reservations ['87930f77-04e9-4431-b528-e83be6ba5d6c', 'fc16ce22-258b-4b9b-83a9-539af93dea39', '584a1b17-c197-48aa-9ad1-23e546450d7c', '42a6c795-2ae7-4a70-b3fd-46706dc234cb'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:35:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:03 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:03 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:03 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:35:03 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:04 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.415s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:04 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:35:04 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Deleted volume successfully. Feb 26 20:35:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-2617c22c-558b-487f-8a89-d887eff24b01 tempest-VolumesGetTest-667622813 None] Lock "cinder-a221532b-34c1-4689-bf19-908ac6f8a5c0-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Flow 'volume_create_manager' (0637018a-910c-4785-9b6d-3082fac279f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e021a1f1-19d1-4b32-afc4-5d2eacf9978e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e021a1f1-19d1-4b32-afc4-5d2eacf9978e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1391686048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa7db3b-7a99-49ad-9054-f5bbc34803d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d1617912bc437a88eef4a413176c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:06Z,use_quota=True,user_id='549666302b1f489a9e754d0a063fac6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50141eb6-5b57-45a0-b0cd-2cd830728b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50141eb6-5b57-45a0-b0cd-2cd830728b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9325a118-9fd7-4b26-9ad9-c8def06e8910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9325a118-9fd7-4b26-9ad9-c8def06e8910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa7db3b-7a99-49ad-9054-f5bbc34803d7', 'volume_name': 'volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deae28a0-5687-4499-826e-9221c15a7360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deae28a0-5687-4499-826e-9221c15a7360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b8c064-5f0b-4ac0-90fd-69e8e46b1df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:06 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Volume daa7db3b-7a99-49ad-9054-f5bbc34803d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7', 'volume_size': 1} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1391686048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa7db3b-7a99-49ad-9054-f5bbc34803d7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d1617912bc437a88eef4a413176c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:06Z,use_quota=True,user_id='549666302b1f489a9e754d0a063fac6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Creating volume daa7db3b-7a99-49ad-9054-f5bbc34803d7 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:35:06 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:06 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7 1073741824 Feb 26 20:35:06 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:06 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7 1073741824" returned: 0 in 0.532s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:06 devstack sudo[90622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7 Feb 26 20:35:06 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:07 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7" returned: 0 in 0.428s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:35:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b8c064-5f0b-4ac0-90fd-69e8e46b1df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76a018d-9fc6-4ed4-9b37-9598f3fbb523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:07 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Volume volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7 (daa7db3b-7a99-49ad-9054-f5bbc34803d7): created successfully Feb 26 20:35:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76a018d-9fc6-4ed4-9b37-9598f3fbb523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:07 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Flow 'volume_create_manager' (0637018a-910c-4785-9b6d-3082fac279f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:07 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0fc2f481-380c-411b-8fcc-a06e7d3f8836 tempest-VolumesListTestJSON-1722993972 None] Created volume successfully. Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Flow 'volume_create_manager' (e63723c4-c043-423f-990e-d46cae0327ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1657029-95da-4d94-8eeb-8b911101904b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1657029-95da-4d94-8eeb-8b911101904b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-441742987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae109541-4f30-475c-b6cb-3c9b5de107e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d1617912bc437a88eef4a413176c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:09Z,use_quota=True,user_id='549666302b1f489a9e754d0a063fac6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f190194-189f-4130-b7eb-308ef0af8bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f190194-189f-4130-b7eb-308ef0af8bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033b0409-9c16-453d-91cb-40886515ce61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (033b0409-9c16-453d-91cb-40886515ce61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae109541-4f30-475c-b6cb-3c9b5de107e1', 'volume_name': 'volume-ae109541-4f30-475c-b6cb-3c9b5de107e1', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276c747c-3d15-4fcd-93e5-4a7dca1a8afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276c747c-3d15-4fcd-93e5-4a7dca1a8afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97d18dc-52b6-4ef4-8024-c63b3a05009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:08 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Volume ae109541-4f30-475c-b6cb-3c9b5de107e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae109541-4f30-475c-b6cb-3c9b5de107e1', 'volume_size': 1} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-441742987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae109541-4f30-475c-b6cb-3c9b5de107e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d1617912bc437a88eef4a413176c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:09Z,use_quota=True,user_id='549666302b1f489a9e754d0a063fac6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Creating volume ae109541-4f30-475c-b6cb-3c9b5de107e1 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:35:08 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:35:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ae109541-4f30-475c-b6cb-3c9b5de107e1 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:08 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ae109541-4f30-475c-b6cb-3c9b5de107e1 1073741824 Feb 26 20:35:08 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:09 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ae109541-4f30-475c-b6cb-3c9b5de107e1 1073741824" returned: 0 in 0.547s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ae109541-4f30-475c-b6cb-3c9b5de107e1 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:09 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ae109541-4f30-475c-b6cb-3c9b5de107e1 Feb 26 20:35:09 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:09 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ae109541-4f30-475c-b6cb-3c9b5de107e1" returned: 0 in 0.478s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:09 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:35:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97d18dc-52b6-4ef4-8024-c63b3a05009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae109541-4f30-475c-b6cb-3c9b5de107e1', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4ac437-7bdc-4497-9238-397cbe511def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:09 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Volume volume-ae109541-4f30-475c-b6cb-3c9b5de107e1 (ae109541-4f30-475c-b6cb-3c9b5de107e1): created successfully Feb 26 20:35:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd4ac437-7bdc-4497-9238-397cbe511def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Flow 'volume_create_manager' (e63723c4-c043-423f-990e-d46cae0327ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:09 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-af79af5d-4df4-4554-918d-90d5d66d83c5 tempest-VolumesListTestJSON-1722993972 None] Created volume successfully. Feb 26 20:35:10 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Flow 'volume_create_manager' (b15df271-499b-47c6-9c90-a0c4c32327c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ee1caa-5b4f-4d1e-bb8d-dd28c7fc3c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ee1caa-5b4f-4d1e-bb8d-dd28c7fc3c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-904053360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864a3c17-be65-4009-91ba-36e18d2f302d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d1617912bc437a88eef4a413176c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:11Z,use_quota=True,user_id='549666302b1f489a9e754d0a063fac6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f709856e-049f-4a89-8a16-3061ffb8a5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f709856e-049f-4a89-8a16-3061ffb8a5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0a3f22-0e43-4d5d-ab5a-3cc2137b3a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0a3f22-0e43-4d5d-ab5a-3cc2137b3a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864a3c17-be65-4009-91ba-36e18d2f302d', 'volume_name': 'volume-864a3c17-be65-4009-91ba-36e18d2f302d', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76da0abf-e765-4dfd-b1d9-cb2a89c1db35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76da0abf-e765-4dfd-b1d9-cb2a89c1db35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aebb93cc-0bda-4014-be54-9f8e738a69bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:11 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Volume 864a3c17-be65-4009-91ba-36e18d2f302d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864a3c17-be65-4009-91ba-36e18d2f302d', 'volume_size': 1} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-904053360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864a3c17-be65-4009-91ba-36e18d2f302d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d1617912bc437a88eef4a413176c81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:11Z,use_quota=True,user_id='549666302b1f489a9e754d0a063fac6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Creating volume 864a3c17-be65-4009-91ba-36e18d2f302d {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:35:11 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-864a3c17-be65-4009-91ba-36e18d2f302d 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:11 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-864a3c17-be65-4009-91ba-36e18d2f302d 1073741824 Feb 26 20:35:11 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:11 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-864a3c17-be65-4009-91ba-36e18d2f302d 1073741824" returned: 0 in 0.513s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-864a3c17-be65-4009-91ba-36e18d2f302d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:11 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-864a3c17-be65-4009-91ba-36e18d2f302d Feb 26 20:35:11 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:12 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-864a3c17-be65-4009-91ba-36e18d2f302d" returned: 0 in 0.433s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:35:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aebb93cc-0bda-4014-be54-9f8e738a69bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864a3c17-be65-4009-91ba-36e18d2f302d', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9e0625-233e-4f29-89fd-f3fc06e3d19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:12 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Volume volume-864a3c17-be65-4009-91ba-36e18d2f302d (864a3c17-be65-4009-91ba-36e18d2f302d): created successfully Feb 26 20:35:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de9e0625-233e-4f29-89fd-f3fc06e3d19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Flow 'volume_create_manager' (b15df271-499b-47c6-9c90-a0c4c32327c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:12 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d736edfd-af72-4b9b-bc25-014fc63b4374 tempest-VolumesListTestJSON-1722993972 None] Created volume successfully. Feb 26 20:35:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "cinder-864a3c17-be65-4009-91ba-36e18d2f302d-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Lock "cinder-864a3c17-be65-4009-91ba-36e18d2f302d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "cinder-quobyte-864a3c17-be65-4009-91ba-36e18d2f302d" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Lock "cinder-quobyte-864a3c17-be65-4009-91ba-36e18d2f302d" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:15 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[176142a3-102c-41e0-a861-1066a17b3969]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-864a3c17-be65-4009-91ba-36e18d2f302d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:15 devstack sudo[90643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-864a3c17-be65-4009-91ba-36e18d2f302d Feb 26 20:35:15 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:15 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-864a3c17-be65-4009-91ba-36e18d2f302d" returned: 0 in 0.493s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-864a3c17-be65-4009-91ba-36e18d2f302d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:15 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-864a3c17-be65-4009-91ba-36e18d2f302d Feb 26 20:35:15 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:16 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-864a3c17-be65-4009-91ba-36e18d2f302d" returned: 0 in 0.414s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Lock "cinder-quobyte-864a3c17-be65-4009-91ba-36e18d2f302d" released by "delete_volume" :: held 0.936s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Created reservations ['16b83b1b-9b9f-4032-b28a-e33b8bbbd041', 'd83ed755-384b-449d-8590-04a63ffc58ff', 'f50edaae-e7cf-4d33-b88c-b941c790f79d', '4ca1c344-a88e-4563-8815-22ad8751892b'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:16 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:35:16 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "cinder-ae109541-4f30-475c-b6cb-3c9b5de107e1-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Lock "cinder-ae109541-4f30-475c-b6cb-3c9b5de107e1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "cinder-quobyte-ae109541-4f30-475c-b6cb-3c9b5de107e1" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Lock "cinder-quobyte-ae109541-4f30-475c-b6cb-3c9b5de107e1" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9b5003-72c4-4e87-916c-6adfa6ce78de]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ae109541-4f30-475c-b6cb-3c9b5de107e1 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:16 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ae109541-4f30-475c-b6cb-3c9b5de107e1 Feb 26 20:35:16 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:16 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.460s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:35:16 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Deleted volume successfully. Feb 26 20:35:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-fe4cce39-a0c0-471d-a753-82c6fca09bf9 tempest-VolumesListTestJSON-1722993972 None] Lock "cinder-864a3c17-be65-4009-91ba-36e18d2f302d-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:17 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ae109541-4f30-475c-b6cb-3c9b5de107e1" returned: 0 in 0.561s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ae109541-4f30-475c-b6cb-3c9b5de107e1 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:17 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ae109541-4f30-475c-b6cb-3c9b5de107e1 Feb 26 20:35:17 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:17 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ae109541-4f30-475c-b6cb-3c9b5de107e1" returned: 0 in 0.449s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Lock "cinder-quobyte-ae109541-4f30-475c-b6cb-3c9b5de107e1" released by "delete_volume" :: held 1.034s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:17 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Created reservations ['becc2ee8-c0b3-45c4-94a5-e2043ef76cd3', '62f4043c-5e35-4b67-86bb-b452fe6f6da1', 'e5427418-425e-461f-8ca9-7bff638d023b', '8d8e326f-7618-4463-8e3d-16cd62168b16'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:35:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:17 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:17 devstack sudo[90662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:35:17 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:18 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.474s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:18 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:35:18 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Deleted volume successfully. Feb 26 20:35:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-1c5dec74-79f1-4b81-8fd7-afdbee0ad934 tempest-VolumesListTestJSON-1722993972 None] Lock "cinder-ae109541-4f30-475c-b6cb-3c9b5de107e1-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "cinder-daa7db3b-7a99-49ad-9054-f5bbc34803d7-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Lock "cinder-daa7db3b-7a99-49ad-9054-f5bbc34803d7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "cinder-quobyte-daa7db3b-7a99-49ad-9054-f5bbc34803d7" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Lock "cinder-quobyte-daa7db3b-7a99-49ad-9054-f5bbc34803d7" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:18 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ac4c2a-f077-484c-bf3b-41d0d789753e]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:18 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7 Feb 26 20:35:18 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:19 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7" returned: 0 in 0.547s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:19 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7 Feb 26 20:35:19 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:19 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-daa7db3b-7a99-49ad-9054-f5bbc34803d7" returned: 0 in 0.521s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Lock "cinder-quobyte-daa7db3b-7a99-49ad-9054-f5bbc34803d7" released by "delete_volume" :: held 1.102s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:20 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Created reservations ['972bcb6c-b95f-4336-8959-4439cad78450', 'b61bffd2-b339-4e6c-9830-719787f47fa7', 'c7982d65-2319-4c67-b9a8-7dddfafd3d3c', 'ad51734b-36ed-4ca0-a333-8a5e7f13222e'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:35:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:20 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:35:20 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:20 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.603s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:20 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:35:20 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Deleted volume successfully. Feb 26 20:35:20 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-28fb8ff7-a92e-47fe-8f38-2c3fcaa24899 tempest-VolumesListTestJSON-1722993972 None] Lock "cinder-daa7db3b-7a99-49ad-9054-f5bbc34803d7-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Flow 'volume_create_manager' (4540beb0-d24a-49f8-864c-85e620732b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86a3017-0152-4c15-8b62-72af8f1ced94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86a3017-0152-4c15-8b62-72af8f1ced94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-997542883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de4e129-8368-4061-a861-93c02dcb40cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86299d3ceb474e974ce2a82c96879e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:23Z,use_quota=True,user_id='06048ee65478454a858db0cd59cca998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a6e4f8-0314-4211-adda-810e001c552e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a6e4f8-0314-4211-adda-810e001c552e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08764b1-b169-4f2a-a148-2bc7ed6a8961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e08764b1-b169-4f2a-a148-2bc7ed6a8961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2de4e129-8368-4061-a861-93c02dcb40cc', 'volume_name': 'volume-2de4e129-8368-4061-a861-93c02dcb40cc', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70cc0ec-e5a7-453f-ba0c-35cfed798e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70cc0ec-e5a7-453f-ba0c-35cfed798e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66dd83a0-83a2-4b6e-9353-71c53d6d47ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:23 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume 2de4e129-8368-4061-a861-93c02dcb40cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2de4e129-8368-4061-a861-93c02dcb40cc', 'volume_size': 1} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-997542883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de4e129-8368-4061-a861-93c02dcb40cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86299d3ceb474e974ce2a82c96879e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:23Z,use_quota=True,user_id='06048ee65478454a858db0cd59cca998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Creating volume 2de4e129-8368-4061-a861-93c02dcb40cc {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:35:23 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2de4e129-8368-4061-a861-93c02dcb40cc 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:23 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2de4e129-8368-4061-a861-93c02dcb40cc 1073741824 Feb 26 20:35:23 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:23 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2de4e129-8368-4061-a861-93c02dcb40cc 1073741824" returned: 0 in 0.539s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2de4e129-8368-4061-a861-93c02dcb40cc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:23 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2de4e129-8368-4061-a861-93c02dcb40cc Feb 26 20:35:23 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:24 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2de4e129-8368-4061-a861-93c02dcb40cc" returned: 0 in 0.419s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66dd83a0-83a2-4b6e-9353-71c53d6d47ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de4e129-8368-4061-a861-93c02dcb40cc', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e644f351-03f0-4e17-83ca-b34d36c59a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG oslo_service.periodic_task [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83352) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:24 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume volume-2de4e129-8368-4061-a861-93c02dcb40cc (2de4e129-8368-4061-a861-93c02dcb40cc): created successfully Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e644f351-03f0-4e17-83ca-b34d36c59a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Flow 'volume_create_manager' (4540beb0-d24a-49f8-864c-85e620732b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:24 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:35:24 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:24 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b16c306a-1931-4d49-be0b-0b02a05e97b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Created volume successfully. Feb 26 20:35:24 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.429s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:24 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Flow 'volume_create_manager' (8615809c-89de-4136-8b77-0aaa91f5f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3deac74-bb84-470b-86d6-eeefc5995dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3deac74-bb84-470b-86d6-eeefc5995dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1648477784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9dbd7af-3c2d-4691-8493-52c56f50f683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86299d3ceb474e974ce2a82c96879e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:25Z,use_quota=True,user_id='06048ee65478454a858db0cd59cca998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3893d90-06e3-42b8-a527-7ae5ef494b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3893d90-06e3-42b8-a527-7ae5ef494b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1821e0ea-60e2-4201-a299-eb206ed64703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1821e0ea-60e2-4201-a299-eb206ed64703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9dbd7af-3c2d-4691-8493-52c56f50f683', 'volume_name': 'volume-a9dbd7af-3c2d-4691-8493-52c56f50f683', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79a5f72-cd39-47e5-8acd-a78f83e9216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79a5f72-cd39-47e5-8acd-a78f83e9216b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3fa3d7-41f5-4f77-8d52-57d56bb1333f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:25 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume a9dbd7af-3c2d-4691-8493-52c56f50f683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9dbd7af-3c2d-4691-8493-52c56f50f683', 'volume_size': 1} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1648477784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9dbd7af-3c2d-4691-8493-52c56f50f683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86299d3ceb474e974ce2a82c96879e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:25Z,use_quota=True,user_id='06048ee65478454a858db0cd59cca998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Creating volume a9dbd7af-3c2d-4691-8493-52c56f50f683 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:35:25 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a9dbd7af-3c2d-4691-8493-52c56f50f683 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:25 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a9dbd7af-3c2d-4691-8493-52c56f50f683 1073741824 Feb 26 20:35:25 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Flow 'volume_create_manager' (8dbdd484-fe2c-4d06-99f4-3c4da557fe4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52c2161-2383-4b24-b643-60a346285513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52c2161-2383-4b24-b643-60a346285513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2048258229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43905b26-b84e-4f02-8fc6-97ae4e6f34dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86299d3ceb474e974ce2a82c96879e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:26Z,use_quota=True,user_id='06048ee65478454a858db0cd59cca998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5b2433-ff2c-4c8c-8c63-b75f10ed7cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5b2433-ff2c-4c8c-8c63-b75f10ed7cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33561b0f-986f-457a-b7bd-51dc2f3e7f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33561b0f-986f-457a-b7bd-51dc2f3e7f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43905b26-b84e-4f02-8fc6-97ae4e6f34dc', 'volume_name': 'volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4debeb-bfa3-4c5a-8a89-699a65998997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4debeb-bfa3-4c5a-8a89-699a65998997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182793be-9419-4457-9bd9-c605ac084c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:25 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume 43905b26-b84e-4f02-8fc6-97ae4e6f34dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc', 'volume_size': 1} Feb 26 20:35:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Flow 'volume_create_manager' (f40a6517-a9b8-44c7-93ec-fb2f36ad171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de85b80e-7af4-4e3c-9735-4fdeb09684f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de85b80e-7af4-4e3c-9735-4fdeb09684f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-265276351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4b76de-0949-46c8-b6fc-f37fcafe22c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86299d3ceb474e974ce2a82c96879e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:26Z,use_quota=True,user_id='06048ee65478454a858db0cd59cca998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb229369-6da2-4cb5-a473-e9fbb27fba51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb229369-6da2-4cb5-a473-e9fbb27fba51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639c6dd1-11e0-4f9a-b1a6-c3fdccf31e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639c6dd1-11e0-4f9a-b1a6-c3fdccf31e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a4b76de-0949-46c8-b6fc-f37fcafe22c5', 'volume_name': 'volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe777920-0cf6-4401-ab63-9a272f1b7c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe777920-0cf6-4401-ab63-9a272f1b7c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13cae1c-83e6-4eec-9031-068510b94492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume 5a4b76de-0949-46c8-b6fc-f37fcafe22c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5', 'volume_size': 1} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:26 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a9dbd7af-3c2d-4691-8493-52c56f50f683 1073741824" returned: 0 in 0.636s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a9dbd7af-3c2d-4691-8493-52c56f50f683 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:26 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a9dbd7af-3c2d-4691-8493-52c56f50f683 Feb 26 20:35:26 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Flow 'volume_create_manager' (832a7ac5-5337-432b-9979-0d27763717fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a476e726-4206-4942-9460-bd0f5f3bf7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a476e726-4206-4942-9460-bd0f5f3bf7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1079044322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a70d90-89ff-41f0-9a52-0fb6c0b477bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86299d3ceb474e974ce2a82c96879e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:26Z,use_quota=True,user_id='06048ee65478454a858db0cd59cca998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b9580a-0b65-48fd-8397-311e7aa93209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3b9580a-0b65-48fd-8397-311e7aa93209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45eb809-562d-4fe2-b314-11295187b345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45eb809-562d-4fe2-b314-11295187b345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a70d90-89ff-41f0-9a52-0fb6c0b477bf', 'volume_name': 'volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22498cb-d5c0-4f7f-a089-c4b6ae431cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a22498cb-d5c0-4f7f-a089-c4b6ae431cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ca4474-f153-4ee8-a17f-2a1159eb948b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume 95a70d90-89ff-41f0-9a52-0fb6c0b477bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf', 'volume_size': 1} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Flow 'volume_create_manager' (b7cf4a3b-f9ee-4ec0-a1ea-67733362e48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880d9455-ca1b-4f0c-97a8-a941fb54ee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880d9455-ca1b-4f0c-97a8-a941fb54ee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794228754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04863285-418c-4a27-93b2-5dae7ba4aeec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86299d3ceb474e974ce2a82c96879e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:26Z,use_quota=True,user_id='06048ee65478454a858db0cd59cca998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2753cd-f9f4-478d-8177-f96ad1e75e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e2753cd-f9f4-478d-8177-f96ad1e75e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336bbc56-f3e3-45ed-946a-1157a22ee90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (336bbc56-f3e3-45ed-946a-1157a22ee90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04863285-418c-4a27-93b2-5dae7ba4aeec', 'volume_name': 'volume-04863285-418c-4a27-93b2-5dae7ba4aeec', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5ce0e4-5b06-4ea4-bd91-d29be0a69951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5ce0e4-5b06-4ea4-bd91-d29be0a69951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfd036f-1c3c-480c-b65a-eda693c90136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume 04863285-418c-4a27-93b2-5dae7ba4aeec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04863285-418c-4a27-93b2-5dae7ba4aeec', 'volume_size': 1} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:26 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a9dbd7af-3c2d-4691-8493-52c56f50f683" returned: 0 in 0.433s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2048258229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43905b26-b84e-4f02-8fc6-97ae4e6f34dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86299d3ceb474e974ce2a82c96879e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:26Z,use_quota=True,user_id='06048ee65478454a858db0cd59cca998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Creating volume 43905b26-b84e-4f02-8fc6-97ae4e6f34dc {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:35:26 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3fa3d7-41f5-4f77-8d52-57d56bb1333f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9dbd7af-3c2d-4691-8493-52c56f50f683', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc 1073741824 Feb 26 20:35:26 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8a0e6a-bff8-4487-81f1-9279203ded62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:26 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume volume-a9dbd7af-3c2d-4691-8493-52c56f50f683 (a9dbd7af-3c2d-4691-8493-52c56f50f683): created successfully Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8a0e6a-bff8-4487-81f1-9279203ded62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:26 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Flow 'volume_create_manager' (8615809c-89de-4136-8b77-0aaa91f5f774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:26 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-723d94d1-0a2a-45f1-8115-3568ffdcfe44 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Created volume successfully. Feb 26 20:35:27 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc 1073741824" returned: 0 in 0.491s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:27 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc Feb 26 20:35:27 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:27 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc" returned: 0 in 0.432s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.513s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-265276351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4b76de-0949-46c8-b6fc-f37fcafe22c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86299d3ceb474e974ce2a82c96879e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:26Z,use_quota=True,user_id='06048ee65478454a858db0cd59cca998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Creating volume 5a4b76de-0949-46c8-b6fc-f37fcafe22c5 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:35:27 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (182793be-9419-4457-9bd9-c605ac084c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:27 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5 1073741824 Feb 26 20:35:27 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd466fbe-e647-4984-9fca-6181723425a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:27 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc (43905b26-b84e-4f02-8fc6-97ae4e6f34dc): created successfully Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd466fbe-e647-4984-9fca-6181723425a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Flow 'volume_create_manager' (8dbdd484-fe2c-4d06-99f4-3c4da557fe4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:27 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d4a38c92-6240-4416-b954-85d3cc4fbcae tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Created volume successfully. Feb 26 20:35:28 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5 1073741824" returned: 0 in 0.488s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:28 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5 Feb 26 20:35:28 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:28 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5" returned: 0 in 0.425s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.236s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1079044322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a70d90-89ff-41f0-9a52-0fb6c0b477bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86299d3ceb474e974ce2a82c96879e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:26Z,use_quota=True,user_id='06048ee65478454a858db0cd59cca998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Creating volume 95a70d90-89ff-41f0-9a52-0fb6c0b477bf {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:35:28 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:28 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf 1073741824 Feb 26 20:35:28 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13cae1c-83e6-4eec-9031-068510b94492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6d037f-8b61-479f-a2b6-7856243247cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:28 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5 (5a4b76de-0949-46c8-b6fc-f37fcafe22c5): created successfully Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6d037f-8b61-479f-a2b6-7856243247cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Flow 'volume_create_manager' (f40a6517-a9b8-44c7-93ec-fb2f36ad171e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:28 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7b93c268-1cc3-46d2-a9ed-ee4beee1cf18 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Created volume successfully. Feb 26 20:35:29 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf 1073741824" returned: 0 in 0.521s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:29 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf Feb 26 20:35:29 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:29 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf" returned: 0 in 0.418s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.012s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-794228754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04863285-418c-4a27-93b2-5dae7ba4aeec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86299d3ceb474e974ce2a82c96879e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:26Z,use_quota=True,user_id='06048ee65478454a858db0cd59cca998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Creating volume 04863285-418c-4a27-93b2-5dae7ba4aeec {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:35:29 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-04863285-418c-4a27-93b2-5dae7ba4aeec 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33ca4474-f153-4ee8-a17f-2a1159eb948b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88efbe22-716b-4678-b053-9330faa3729f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:29 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-04863285-418c-4a27-93b2-5dae7ba4aeec 1073741824 Feb 26 20:35:29 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:29 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf (95a70d90-89ff-41f0-9a52-0fb6c0b477bf): created successfully Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88efbe22-716b-4678-b053-9330faa3729f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Flow 'volume_create_manager' (832a7ac5-5337-432b-9979-0d27763717fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:29 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-38a85ad3-8cd0-4058-baeb-c5167c47573f tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Created volume successfully. Feb 26 20:35:30 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-04863285-418c-4a27-93b2-5dae7ba4aeec 1073741824" returned: 0 in 0.569s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-04863285-418c-4a27-93b2-5dae7ba4aeec {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:30 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-04863285-418c-4a27-93b2-5dae7ba4aeec Feb 26 20:35:30 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:30 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-04863285-418c-4a27-93b2-5dae7ba4aeec" returned: 0 in 0.453s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfd036f-1c3c-480c-b65a-eda693c90136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04863285-418c-4a27-93b2-5dae7ba4aeec', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ef5607-bcc1-4e20-96cc-7ec5336b53be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:30 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Volume volume-04863285-418c-4a27-93b2-5dae7ba4aeec (04863285-418c-4a27-93b2-5dae7ba4aeec): created successfully Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92ef5607-bcc1-4e20-96cc-7ec5336b53be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Flow 'volume_create_manager' (b7cf4a3b-f9ee-4ec0-a1ea-67733362e48f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:30 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a4f9dcda-2ad4-41e4-afdd-6ce3a41fc815 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Created volume successfully. Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "cinder-04863285-418c-4a27-93b2-5dae7ba4aeec-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-04863285-418c-4a27-93b2-5dae7ba4aeec-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "cinder-quobyte-04863285-418c-4a27-93b2-5dae7ba4aeec" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-quobyte-04863285-418c-4a27-93b2-5dae7ba4aeec" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:31 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[985bb529-c2cb-4bf0-9073-1381413b54e3]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-04863285-418c-4a27-93b2-5dae7ba4aeec {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:31 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-04863285-418c-4a27-93b2-5dae7ba4aeec Feb 26 20:35:31 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:31 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-04863285-418c-4a27-93b2-5dae7ba4aeec" returned: 0 in 0.550s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-04863285-418c-4a27-93b2-5dae7ba4aeec {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:31 devstack sudo[90735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-04863285-418c-4a27-93b2-5dae7ba4aeec Feb 26 20:35:31 devstack sudo[90735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:32 devstack sudo[90735]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-04863285-418c-4a27-93b2-5dae7ba4aeec" returned: 0 in 0.496s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-quobyte-04863285-418c-4a27-93b2-5dae7ba4aeec" released by "delete_volume" :: held 1.072s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:32 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Created reservations ['e546993f-4742-4a60-a1c0-03ad02c3d3b8', '68b6e30a-0ab3-4e96-a382-f1d16604b02d', 'bdffe954-e0d3-4aa3-b8cf-4346cd508b0e', '941a3757-00bd-4093-a5ed-5d5b80222781'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:35:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:32 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:35:32 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:32 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.484s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:32 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:35:32 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Deleted volume successfully. Feb 26 20:35:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a819d8c9-00c2-4493-a582-d0ac35ffaf0a tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-04863285-418c-4a27-93b2-5dae7ba4aeec-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "cinder-95a70d90-89ff-41f0-9a52-0fb6c0b477bf-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-95a70d90-89ff-41f0-9a52-0fb6c0b477bf-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "cinder-quobyte-95a70d90-89ff-41f0-9a52-0fb6c0b477bf" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-quobyte-95a70d90-89ff-41f0-9a52-0fb6c0b477bf" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:33 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[4875e0de-95b1-4ffb-a39f-16ac17b82790]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:33 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf Feb 26 20:35:33 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:33 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf" returned: 0 in 0.537s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:33 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf Feb 26 20:35:33 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:34 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-95a70d90-89ff-41f0-9a52-0fb6c0b477bf" returned: 0 in 0.431s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-quobyte-95a70d90-89ff-41f0-9a52-0fb6c0b477bf" released by "delete_volume" :: held 1.001s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:34 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Created reservations ['1b2999f5-5ea3-438a-9dd3-5be7be74f92b', '91045cd8-80c6-49e4-8f34-6198809f00aa', '23f29fe4-fa7b-4d90-a97a-ef70a95e91f1', '957e58a5-d7bf-4e0f-9800-3f298e1ee0d1'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:35:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:34 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:35:34 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:34 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.415s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:34 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:35:34 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Deleted volume successfully. Feb 26 20:35:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-504b6bfb-8801-4a7c-a894-6a33107f7d26 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-95a70d90-89ff-41f0-9a52-0fb6c0b477bf-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:35 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "cinder-5a4b76de-0949-46c8-b6fc-f37fcafe22c5-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:35 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-5a4b76de-0949-46c8-b6fc-f37fcafe22c5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:35 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "cinder-quobyte-5a4b76de-0949-46c8-b6fc-f37fcafe22c5" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:35 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-quobyte-5a4b76de-0949-46c8-b6fc-f37fcafe22c5" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:35 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[166a2d8f-4505-4788-98c0-4ad4095b0d53]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:35 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5 Feb 26 20:35:35 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:35 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5" returned: 0 in 0.507s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:35 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5 Feb 26 20:35:35 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:36 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5a4b76de-0949-46c8-b6fc-f37fcafe22c5" returned: 0 in 0.418s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:36 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-quobyte-5a4b76de-0949-46c8-b6fc-f37fcafe22c5" released by "delete_volume" :: held 0.965s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:36 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Created reservations ['3539d7f4-bd9b-4dab-89bb-911bab35e49a', '456ba020-073a-44bd-9e55-a47561f9d630', '09ab0402-1b09-40d3-944a-4c7219c8c47a', '137e616a-5c36-48d2-8566-fa919794b5bd'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:35:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:36 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:35:36 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:36 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.429s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:36 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:35:36 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Deleted volume successfully. Feb 26 20:35:36 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-09b830be-472d-4655-adde-c15847654366 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-5a4b76de-0949-46c8-b6fc-f37fcafe22c5-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "cinder-43905b26-b84e-4f02-8fc6-97ae4e6f34dc-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-43905b26-b84e-4f02-8fc6-97ae4e6f34dc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "cinder-quobyte-43905b26-b84e-4f02-8fc6-97ae4e6f34dc" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-quobyte-43905b26-b84e-4f02-8fc6-97ae4e6f34dc" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:37 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d608be3-f23c-4581-987e-fba5a8b11336]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:37 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc Feb 26 20:35:37 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:38 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc" returned: 0 in 0.607s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:38 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc Feb 26 20:35:38 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:38 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-43905b26-b84e-4f02-8fc6-97ae4e6f34dc" returned: 0 in 0.533s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:38 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-quobyte-43905b26-b84e-4f02-8fc6-97ae4e6f34dc" released by "delete_volume" :: held 1.165s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:38 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:UPDATE=129,cinder:SELECT=96,cinder:INSERT=43,cinder:DELETE=12 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:35:38 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Created reservations ['44fd41a4-7909-40be-a46c-50f986d5fa8d', 'bc94ef64-baa9-438d-b3ed-6a57befd0ebf', '0696cf25-3ca0-4afc-8393-0dd9a49513ee', '53aad679-423f-4520-b104-8a55a2b4c6d4'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:35:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:38 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:35:38 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:39 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.486s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:39 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:35:39 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Deleted volume successfully. Feb 26 20:35:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eb326763-e8e0-4992-abe1-fe55dcd5e8b9 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-43905b26-b84e-4f02-8fc6-97ae4e6f34dc-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "cinder-a9dbd7af-3c2d-4691-8493-52c56f50f683-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-a9dbd7af-3c2d-4691-8493-52c56f50f683-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "cinder-quobyte-a9dbd7af-3c2d-4691-8493-52c56f50f683" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-quobyte-a9dbd7af-3c2d-4691-8493-52c56f50f683" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:39 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bcaa70-5412-486e-8eb7-ea0a3359ac0d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a9dbd7af-3c2d-4691-8493-52c56f50f683 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:39 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a9dbd7af-3c2d-4691-8493-52c56f50f683 Feb 26 20:35:39 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:40 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a9dbd7af-3c2d-4691-8493-52c56f50f683" returned: 0 in 0.550s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a9dbd7af-3c2d-4691-8493-52c56f50f683 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:40 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a9dbd7af-3c2d-4691-8493-52c56f50f683 Feb 26 20:35:40 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:40 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a9dbd7af-3c2d-4691-8493-52c56f50f683" returned: 0 in 0.465s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:40 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-quobyte-a9dbd7af-3c2d-4691-8493-52c56f50f683" released by "delete_volume" :: held 1.041s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:40 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Created reservations ['a18e5a7f-98da-4744-9c13-5f7ced1b31a2', '7b446a21-a75b-41cd-ab24-83091ba385a9', 'd763bfe1-f971-49a5-8345-18c6b072870a', '873e7000-33da-442b-ae5c-ddab5eb7e720'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:35:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:40 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:40 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:35:40 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:41 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.448s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:41 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:35:41 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Deleted volume successfully. Feb 26 20:35:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7ef7926a-f872-4332-ab02-e16fc6db1fcc tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-a9dbd7af-3c2d-4691-8493-52c56f50f683-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "cinder-2de4e129-8368-4061-a861-93c02dcb40cc-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-2de4e129-8368-4061-a861-93c02dcb40cc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "cinder-quobyte-2de4e129-8368-4061-a861-93c02dcb40cc" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-quobyte-2de4e129-8368-4061-a861-93c02dcb40cc" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:41 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[686ce86c-e1e2-4e62-b284-6ee344baccf2]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2de4e129-8368-4061-a861-93c02dcb40cc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:42 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2de4e129-8368-4061-a861-93c02dcb40cc Feb 26 20:35:42 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:42 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2de4e129-8368-4061-a861-93c02dcb40cc" returned: 0 in 0.534s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2de4e129-8368-4061-a861-93c02dcb40cc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:42 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2de4e129-8368-4061-a861-93c02dcb40cc Feb 26 20:35:42 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:42 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2de4e129-8368-4061-a861-93c02dcb40cc" returned: 0 in 0.442s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-quobyte-2de4e129-8368-4061-a861-93c02dcb40cc" released by "delete_volume" :: held 1.007s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:42 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Created reservations ['69f8780a-5bbe-4926-b38a-4a555582b312', '852737d0-0fec-4cb5-ac68-28f261846fd1', 'fd076cf3-2053-4a1a-9b16-6e3c6cc1456d', '96f8314d-fc65-4d17-ac1e-cd6d28b1c2c1'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:35:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:43 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:35:43 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:43 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.496s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:43 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:35:43 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Deleted volume successfully. Feb 26 20:35:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-acd98ee0-f640-41b5-90d3-17211cd04ca6 tempest-CreateVolumesFromSourceVolumeTest-409490091 None] Lock "cinder-2de4e129-8368-4061-a861-93c02dcb40cc-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Flow 'volume_create_manager' (6af6013b-4180-4048-8257-f32361bc59cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcdec2c0-96d0-410f-9c99-6a76658678da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcdec2c0-96d0-410f-9c99-6a76658678da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2025152774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4a5be8-0524-4cc2-8cee-0cb072c975bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fceb9df98824abfafe80f905262ec96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:46Z,use_quota=True,user_id='26b83041a3714c30b91021d41d916c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68419ab0-5955-475b-b80c-ef5d28ddcde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68419ab0-5955-475b-b80c-ef5d28ddcde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d925de76-2333-466b-9dc2-ea1b30177bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d925de76-2333-466b-9dc2-ea1b30177bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d4a5be8-0524-4cc2-8cee-0cb072c975bf', 'volume_name': 'volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0697e468-1d94-4a0a-98c7-cf40bacd1554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0697e468-1d94-4a0a-98c7-cf40bacd1554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea1f977-d992-463f-a43d-d749873164a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:46 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Volume 2d4a5be8-0524-4cc2-8cee-0cb072c975bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf', 'volume_size': 1} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2025152774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d4a5be8-0524-4cc2-8cee-0cb072c975bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fceb9df98824abfafe80f905262ec96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:46Z,use_quota=True,user_id='26b83041a3714c30b91021d41d916c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Creating volume 2d4a5be8-0524-4cc2-8cee-0cb072c975bf {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:35:46 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:46 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf 1073741824 Feb 26 20:35:46 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:46 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf 1073741824" returned: 0 in 0.499s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:46 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf Feb 26 20:35:46 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:47 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" returned: 0 in 0.422s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:35:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea1f977-d992-463f-a43d-d749873164a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b933b0-548f-4e95-abdf-dd1b044e0088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:47 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Volume volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf (2d4a5be8-0524-4cc2-8cee-0cb072c975bf): created successfully Feb 26 20:35:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b933b0-548f-4e95-abdf-dd1b044e0088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:47 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Flow 'volume_create_manager' (6af6013b-4180-4048-8257-f32361bc59cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:47 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-399aff47-0aec-4698-b77f-951b962a4df3 tempest-VolumeDependencyTests-1223387648 None] Created volume successfully. Feb 26 20:35:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] Creating offline snapshot ee66f29d-c907-4d7b-8910-23d872108bb8 of volume 2d4a5be8-0524-4cc2-8cee-0cb072c975bf {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:35:48 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe9fa7c-88de-4405-9d0a-7fab9b1dc8d1]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:48 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf Feb 26 20:35:48 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:48 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" returned: 0 in 0.494s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:48 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 1G Feb 26 20:35:48 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:49 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 1G" returned: 0 in 0.523s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:49 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 Feb 26 20:35:49 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:49 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8" returned: 0 in 0.449s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:49 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 is being set with open permissions: ugo+rw Feb 26 20:35:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:49 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 Feb 26 20:35:49 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:50 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8" returned: 0 in 0.429s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:50 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=80,cinder:INSERT=25,cinder:UPDATE=126,cinder:DELETE=11 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:35:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:50 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.info Feb 26 20:35:50 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:50 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.info" returned: 0 in 0.469s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:50 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.info is being set with open permissions: ugo+rw Feb 26 20:35:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:50 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.info Feb 26 20:35:50 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:51 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.info" returned: 0 in 0.422s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.857s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:51 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-9c8f1bb2-2124-41ae-81fe-e189e4625427 tempest-VolumeDependencyTests-1223387648 None] Create snapshot completed successfully Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Flow 'volume_create_manager' (9b6409fd-2c18-485b-b91a-c89bead225f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37efa7db-bbda-42e7-9366-d8da1b22a89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37efa7db-bbda-42e7-9366-d8da1b22a89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-274660599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a8b174-9ebe-4b05-bb72-34b4161669ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fceb9df98824abfafe80f905262ec96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ee66f29d-c907-4d7b-8910-23d872108bb8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:35:52Z,use_quota=True,user_id='26b83041a3714c30b91021d41d916c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1a45da-bee9-4b32-bb2a-4472f3d2a9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1a45da-bee9-4b32-bb2a-4472f3d2a9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b9b804-fbdc-476c-8880-d3ae6c0cd424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b9b804-fbdc-476c-8880-d3ae6c0cd424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '36a8b174-9ebe-4b05-bb72-34b4161669ff', 'volume_name': 'volume-36a8b174-9ebe-4b05-bb72-34b4161669ff', 'volume_size': 1, 'snapshot_id': 'ee66f29d-c907-4d7b-8910-23d872108bb8'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbfdd8b-fdfa-4ca2-91de-3d63fbdc407b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbfdd8b-fdfa-4ca2-91de-3d63fbdc407b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171f6705-85b8-4755-901f-e2da72b7eef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:51 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Volume 36a8b174-9ebe-4b05-bb72-34b4161669ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-36a8b174-9ebe-4b05-bb72-34b4161669ff', 'volume_size': 1, 'snapshot_id': 'ee66f29d-c907-4d7b-8910-23d872108bb8'} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-quobyte-ee66f29d-c907-4d7b-8910-23d872108bb8-36a8b174-9ebe-4b05-bb72-34b4161669ff" by "_create_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-ee66f29d-c907-4d7b-8910-23d872108bb8-36a8b174-9ebe-4b05-bb72-34b4161669ff" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Creating volume 36a8b174-9ebe-4b05-bb72-34b4161669ff from snapshot ee66f29d-c907-4d7b-8910-23d872108bb8 {{(pid=83352) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-quobyte-36a8b174-9ebe-4b05-bb72-34b4161669ff" by "_copy_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-36a8b174-9ebe-4b05-bb72-34b4161669ff" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] snapshot: ee66f29d-c907-4d7b-8910-23d872108bb8, volume: 36a8b174-9ebe-4b05-bb72-34b4161669ff, {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[579b045e-7e43-4037-974f-3e934238c2a9]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:51 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 Feb 26 20:35:51 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:52 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8" returned: 0 in 0.486s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:35:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 20:35:52 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Creating direct copy from snapshot {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 20:35:52 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[9302899a-002a-4ab5-aa19-7edfaba0907c]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:52 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf Feb 26 20:35:52 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:52 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" returned: 0 in 0.503s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:52 devstack cinder-volume[83352]: DEBUG cinder.utils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Path /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff not found in is_blk_device check {{(pid=83352) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 20:35:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:52 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff Feb 26 20:35:52 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:55 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff" returned: 0 in 2.187s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:55 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[651487d5-aef6-43ce-82b9-a8a6159bf2de]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:55 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf Feb 26 20:35:55 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:55 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" returned: 0 in 0.639s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:55 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf, size 1024.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:35:55 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Converted 1024.00 MB image at 468.09 MB/s Feb 26 20:35:55 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff is being set with open permissions: ugo+rw Feb 26 20:35:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:55 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff Feb 26 20:35:55 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:56 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff" returned: 0 in 0.428s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-36a8b174-9ebe-4b05-bb72-34b4161669ff" released by "_copy_volume_from_snapshot" :: held 4.304s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-ee66f29d-c907-4d7b-8910-23d872108bb8-36a8b174-9ebe-4b05-bb72-34b4161669ff" released by "_create_volume_from_snapshot" :: held 4.322s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.333s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:35:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171f6705-85b8-4755-901f-e2da72b7eef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a8b174-9ebe-4b05-bb72-34b4161669ff', 'volume_size': 1, 'snapshot_id': 'ee66f29d-c907-4d7b-8910-23d872108bb8'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c12e2a-b876-4681-b84c-ed781dbb07bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:35:56 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Volume volume-36a8b174-9ebe-4b05-bb72-34b4161669ff (36a8b174-9ebe-4b05-bb72-34b4161669ff): created successfully Feb 26 20:35:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c12e2a-b876-4681-b84c-ed781dbb07bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:35:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Flow 'volume_create_manager' (9b6409fd-2c18-485b-b91a-c89bead225f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:35:56 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-9099c009-37d9-4164-9c19-501f2bf63a96 tempest-VolumeDependencyTests-1223387648 None] Created volume successfully. Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-ee66f29d-c907-4d7b-8910-23d872108bb8-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-ee66f29d-c907-4d7b-8910-23d872108bb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-quobyte-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-quobyte-ee66f29d-c907-4d7b-8910-23d872108bb8" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-ee66f29d-c907-4d7b-8910-23d872108bb8" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Deleting offline snapshot ee66f29d-c907-4d7b-8910-23d872108bb8 of volume 2d4a5be8-0524-4cc2-8cee-0cb072c975bf {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] snapshot_file for this snap is: volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d9e2d5-18dd-42ce-a84d-0b44395a0198]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:57 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 Feb 26 20:35:57 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:57 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8" returned: 0 in 0.498s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[b405cced-0e7b-4909-b002-3637c6c5677a]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:57 devstack sudo[90907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf Feb 26 20:35:57 devstack sudo[90907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:58 devstack sudo[90907]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" returned: 0 in 0.471s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:58 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 Feb 26 20:35:58 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:58 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8" returned: 0 in 0.457s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:58 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8 Feb 26 20:35:58 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:59 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf.ee66f29d-c907-4d7b-8910-23d872108bb8" returned: 0 in 0.424s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-ee66f29d-c907-4d7b-8910-23d872108bb8" released by "_delete_snapshot" :: held 1.917s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" released by "delete_snapshot" :: held 1.931s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Created reservations ['c2978ddf-f23f-4c25-a202-778a16ed52ae', '485b5102-36cc-4bb9-a34b-91bf96a16a71', '7e86ae8a-26e3-4d07-b2a2-fe6143396d04', 'aa44362b-54bc-4f0e-90a1-5e95208bd7a7'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:35:59 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Delete snapshot completed successfully. Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4daab0da-d684-46df-9a1d-b525221983ad tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-ee66f29d-c907-4d7b-8910-23d872108bb8-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-2d4a5be8-0524-4cc2-8cee-0cb072c975bf-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-2d4a5be8-0524-4cc2-8cee-0cb072c975bf-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-quobyte-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[e395409c-0930-423b-9e9b-812d1f41fb19]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:59 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf Feb 26 20:35:59 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:35:59 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" returned: 0 in 0.533s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:35:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:35:59 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf Feb 26 20:35:59 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:00 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" returned: 0 in 0.430s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-2d4a5be8-0524-4cc2-8cee-0cb072c975bf" released by "delete_volume" :: held 1.001s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:00 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Created reservations ['11c57004-534e-4228-b983-1a3ad7e6520f', '14a8d23d-8c27-4e8f-b0e0-8e5b7e68560b', 'dd8a566c-524b-417e-b155-c2fee12cfc81', '27b82ed1-f8d7-40c4-a2cc-8cfd2e5471c9'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:36:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:00 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:00 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:36:00 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:00 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.437s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:00 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:36:00 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Deleted volume successfully. Feb 26 20:36:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3811bf0a-5ffb-4695-af76-e13fb12bf9a6 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-2d4a5be8-0524-4cc2-8cee-0cb072c975bf-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Flow 'volume_create_manager' (9381c14e-c694-479d-86bf-8da24892c37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46542bd-9164-4879-b6a6-c7c65d032eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c46542bd-9164-4879-b6a6-c7c65d032eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-986820495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adeaacfc-a190-4f7c-bca7-f66681d3f364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fceb9df98824abfafe80f905262ec96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:02Z,use_quota=True,user_id='26b83041a3714c30b91021d41d916c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c6c284-9f52-4916-9a7f-b8e371f52802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c6c284-9f52-4916-9a7f-b8e371f52802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e99651f-4216-47fb-b291-4b3d79fcba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e99651f-4216-47fb-b291-4b3d79fcba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adeaacfc-a190-4f7c-bca7-f66681d3f364', 'volume_name': 'volume-adeaacfc-a190-4f7c-bca7-f66681d3f364', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c37385b-f2cd-4f16-8124-29d11a14f738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c37385b-f2cd-4f16-8124-29d11a14f738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c90e69-c0dc-464b-9fcf-95638a6b9d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:01 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Volume adeaacfc-a190-4f7c-bca7-f66681d3f364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adeaacfc-a190-4f7c-bca7-f66681d3f364', 'volume_size': 1} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-986820495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adeaacfc-a190-4f7c-bca7-f66681d3f364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fceb9df98824abfafe80f905262ec96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:02Z,use_quota=True,user_id='26b83041a3714c30b91021d41d916c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Creating volume adeaacfc-a190-4f7c-bca7-f66681d3f364 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:01 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:01 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 1073741824 Feb 26 20:36:01 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:02 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 1073741824" returned: 0 in 0.538s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:02 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 Feb 26 20:36:02 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:02 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364" returned: 0 in 0.448s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:02 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c90e69-c0dc-464b-9fcf-95638a6b9d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adeaacfc-a190-4f7c-bca7-f66681d3f364', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a41319-bacd-4e66-8515-18dc67fbb62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:02 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Volume volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 (adeaacfc-a190-4f7c-bca7-f66681d3f364): created successfully Feb 26 20:36:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a41319-bacd-4e66-8515-18dc67fbb62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Flow 'volume_create_manager' (9381c14e-c694-479d-86bf-8da24892c37e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:02 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-46cb5707-30a1-49ba-8907-b561f5380f71 tempest-VolumeDependencyTests-1223387648 None] Created volume successfully. Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Flow 'volume_create_manager' (18dca808-912a-4ae7-9488-3e0a18e0ea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312654bc-d9ca-4ae9-a0a9-38954b79df0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312654bc-d9ca-4ae9-a0a9-38954b79df0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-77244569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fceb9df98824abfafe80f905262ec96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=adeaacfc-a190-4f7c-bca7-f66681d3f364,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:04Z,use_quota=True,user_id='26b83041a3714c30b91021d41d916c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab854b3b-4667-4a9d-b6b7-feb271522052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab854b3b-4667-4a9d-b6b7-feb271522052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29925cf0-00dc-46d3-9a2b-1e7d33684c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29925cf0-00dc-46d3-9a2b-1e7d33684c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6', 'volume_name': 'volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6', 'volume_size': 1, 'source_volid': 'adeaacfc-a190-4f7c-bca7-f66681d3f364', 'source_volstatus': 'available'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092aef73-fd0b-46f2-9e3b-8876334753d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092aef73-fd0b-46f2-9e3b-8876334753d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098bc3b4-001c-4f1b-9c11-6f6c3b9e350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:04 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Volume cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6', 'volume_size': 1, 'source_volid': 'adeaacfc-a190-4f7c-bca7-f66681d3f364', 'source_volstatus': 'available'} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:04 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Cloning volume adeaacfc-a190-4f7c-bca7-f66681d3f364 to volume cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Creating offline snapshot 26866957-a217-484a-8f0e-a20b1d806893 of volume adeaacfc-a190-4f7c-bca7-f66681d3f364 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c46bd5-e39a-4286-9359-03718981b745]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:04 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 Feb 26 20:36:04 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:04 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364" returned: 0 in 0.550s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:04 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 1G Feb 26 20:36:04 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:05 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 1G" returned: 0 in 0.484s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:05 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 Feb 26 20:36:05 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:05 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893" returned: 0 in 0.429s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:05 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 is being set with open permissions: ugo+rw Feb 26 20:36:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:05 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 Feb 26 20:36:05 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:06 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893" returned: 0 in 0.435s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:06 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.info Feb 26 20:36:06 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:06 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.info" returned: 0 in 0.407s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:06 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.info is being set with open permissions: ugo+rw Feb 26 20:36:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:06 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.info Feb 26 20:36:06 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:07 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.info" returned: 0 in 0.405s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-quobyte-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6" by "_copy_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] snapshot: 26866957-a217-484a-8f0e-a20b1d806893, volume: cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6, {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[706a8732-39cc-49f0-878b-2219bdd84acc]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:07 devstack sudo[90966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 Feb 26 20:36:07 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:07 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893" returned: 0 in 0.478s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adeaacfc-a190-4f7c-bca7-f66681d3f364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Creating direct copy from snapshot {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[81539063-f020-4d87-adb0-655b21b8ec73]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:07 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 Feb 26 20:36:07 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:08 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364" returned: 0 in 0.465s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:08 devstack cinder-volume[83352]: DEBUG cinder.utils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Path /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 not found in is_blk_device check {{(pid=83352) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 20:36:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:08 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 Feb 26 20:36:08 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:10 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6" returned: 0 in 2.032s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:10 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a4a43-00fd-4df1-bc36-65aebfa96253]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:10 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 Feb 26 20:36:10 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:10 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364" returned: 0 in 0.616s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:10 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364, size 1024.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:36:10 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Converted 1024.00 MB image at 503.63 MB/s Feb 26 20:36:10 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 is being set with open permissions: ugo+rw Feb 26 20:36:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:10 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 Feb 26 20:36:10 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:11 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6" returned: 0 in 0.409s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:11 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6" released by "_copy_volume_from_snapshot" :: held 4.052s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:11 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-quobyte-26866957-a217-484a-8f0e-a20b1d806893" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:11 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-26866957-a217-484a-8f0e-a20b1d806893" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Deleting offline snapshot 26866957-a217-484a-8f0e-a20b1d806893 of volume adeaacfc-a190-4f7c-bca7-f66681d3f364 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:36:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] snapshot_file for this snap is: volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:36:11 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ccbd63-b763-449d-a569-30b2fb82f5aa]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:11 devstack sudo[90997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 Feb 26 20:36:11 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:11 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893" returned: 0 in 0.529s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-adeaacfc-a190-4f7c-bca7-f66681d3f364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:36:11 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ca9d1e-3ce2-4c40-9e5f-371906f59f93]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:11 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 Feb 26 20:36:11 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:12 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364" returned: 0 in 0.478s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:12 devstack sudo[91007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 Feb 26 20:36:12 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:12 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893" returned: 0 in 0.473s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:12 devstack sudo[91012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893 Feb 26 20:36:12 devstack sudo[91012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:13 devstack sudo[91012]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364.26866957-a217-484a-8f0e-a20b1d806893" returned: 0 in 0.415s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-26866957-a217-484a-8f0e-a20b1d806893" released by "_delete_snapshot" :: held 1.950s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.844s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098bc3b4-001c-4f1b-9c11-6f6c3b9e350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6', 'volume_size': 1, 'source_volid': 'adeaacfc-a190-4f7c-bca7-f66681d3f364', 'source_volstatus': 'available'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0b2dc5-905b-4377-9d3b-ea81b8c45928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:13 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Volume volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 (cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6): created successfully Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0b2dc5-905b-4377-9d3b-ea81b8c45928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Flow 'volume_create_manager' (18dca808-912a-4ae7-9488-3e0a18e0ea29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:13 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e3963141-792d-44bc-bcfe-48fcc9daa6f1 tempest-VolumeDependencyTests-1223387648 None] Created volume successfully. Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-adeaacfc-a190-4f7c-bca7-f66681d3f364-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-adeaacfc-a190-4f7c-bca7-f66681d3f364-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-quobyte-adeaacfc-a190-4f7c-bca7-f66681d3f364" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-adeaacfc-a190-4f7c-bca7-f66681d3f364" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81a97bd-db22-489e-8aa3-173d511cc0a7]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:14 devstack sudo[91015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 Feb 26 20:36:14 devstack sudo[91015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:14 devstack sudo[91015]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364" returned: 0 in 0.499s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:14 devstack sudo[91020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364 Feb 26 20:36:14 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:14 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-adeaacfc-a190-4f7c-bca7-f66681d3f364" returned: 0 in 0.419s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:14 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-adeaacfc-a190-4f7c-bca7-f66681d3f364" released by "delete_volume" :: held 0.963s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:14 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Created reservations ['34bb3835-27fa-4bed-be66-69addcc75b1e', 'cd67c91e-6ab7-4f6c-a1fe-3ec636f687e3', '0fcb5a63-4a12-4323-98d7-a349c6b6c0ff', '0e039893-631c-402e-a177-9e1a6094aad7'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:36:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:15 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:36:15 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-quobyte-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6" acquired by "delete_volume" :: waited 0.016s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:15 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb5aaf8-c445-4a2e-ba17-b555cf1198ae]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:15 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 Feb 26 20:36:15 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:15 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.465s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:15 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:36:15 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Deleted volume successfully. Feb 26 20:36:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a21777e0-bcf1-4f58-9ff4-eda3d14323b7 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-adeaacfc-a190-4f7c-bca7-f66681d3f364-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:15 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6" returned: 0 in 0.528s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:15 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6 Feb 26 20:36:15 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:16 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6" returned: 0 in 0.406s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6" released by "delete_volume" :: held 0.960s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:16 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Created reservations ['6599f681-8cd6-41a1-8719-717ef985c43c', 'dd01e2a4-e233-4c1d-a6e0-8f56d0395d89', '6f8684c8-316d-443e-a501-39427acce238', '9923b580-d30f-4276-91c6-d761ec095c18'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:36:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:16 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:36:16 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:16 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.397s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:16 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:36:16 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Deleted volume successfully. Feb 26 20:36:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-440c926a-7a67-4cb5-ae42-1231447ff3cf tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-cd7a4d85-bdb9-42f6-bffb-9d04bdfa2ca6-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-36a8b174-9ebe-4b05-bb72-34b4161669ff-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-36a8b174-9ebe-4b05-bb72-34b4161669ff-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "cinder-quobyte-36a8b174-9ebe-4b05-bb72-34b4161669ff" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:17 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-36a8b174-9ebe-4b05-bb72-34b4161669ff" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:17 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1e599f-cf35-49e3-901b-9644ddaa2f85]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:17 devstack sudo[91037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff Feb 26 20:36:17 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:17 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff" returned: 0 in 0.514s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:17 devstack sudo[91042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff Feb 26 20:36:17 devstack sudo[91042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:18 devstack sudo[91042]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-36a8b174-9ebe-4b05-bb72-34b4161669ff" returned: 0 in 0.438s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-quobyte-36a8b174-9ebe-4b05-bb72-34b4161669ff" released by "delete_volume" :: held 0.981s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:18 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Created reservations ['cbd9e3c0-a928-4e1d-86ec-205235c70d71', '8893df09-814f-4c1c-ba62-d2be3a8d1572', 'e4a7174e-3e60-4e87-91ac-3f792e9c048f', '68fcde58-bc18-4a93-838d-007698dc3fa1'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:36:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:18 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:36:18 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:18 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.401s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:18 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:36:18 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Deleted volume successfully. Feb 26 20:36:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25e0dce8-6ea2-4306-b500-7295677df842 tempest-VolumeDependencyTests-1223387648 None] Lock "cinder-36a8b174-9ebe-4b05-bb72-34b4161669ff-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:24 devstack cinder-volume[83352]: DEBUG oslo_service.periodic_task [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83352) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:36:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:24 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:36:24 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:24 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.597s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:24 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Flow 'volume_create_manager' (7e22372a-f384-4e4d-b9ab-03f9c0f1744c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f33b80-ace9-4d27-8109-c45bf00e3bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89f33b80-ace9-4d27-8109-c45bf00e3bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1928755411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfc5ee6-690a-4e02-a498-99ecb50f6688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4301cc1ac33c426185232bafd7a6197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:28Z,use_quota=True,user_id='ccde577a9edc45199e5a79f40850ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0135ee7b-ae13-4103-856a-35b5408ef692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0135ee7b-ae13-4103-856a-35b5408ef692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6155bd8a-94dc-4a14-8aa7-9669c351f7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6155bd8a-94dc-4a14-8aa7-9669c351f7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcfc5ee6-690a-4e02-a498-99ecb50f6688', 'volume_name': 'volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9a5ac6-dac4-4bbf-b238-bd6ee6711585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9a5ac6-dac4-4bbf-b238-bd6ee6711585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b65b0f-14b1-4781-a15e-56a471dadc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:27 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Volume dcfc5ee6-690a-4e02-a498-99ecb50f6688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688', 'volume_size': 1} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1928755411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfc5ee6-690a-4e02-a498-99ecb50f6688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4301cc1ac33c426185232bafd7a6197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:28Z,use_quota=True,user_id='ccde577a9edc45199e5a79f40850ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Creating volume dcfc5ee6-690a-4e02-a498-99ecb50f6688 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:27 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:28 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 1073741824 Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Flow 'volume_create_manager' (06034d36-3121-4e94-8579-a61fc0a0eb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:28 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ec024d-f163-48cd-b54a-3abf410796a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ec024d-f163-48cd-b54a-3abf410796a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1091942397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3800c723-1a8d-400d-9a06-00c4ec52991f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5b1b163c24dd184177b6694a30259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:28Z,use_quota=True,user_id='1f418e8020684ead9d865b57618fd281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d947a683-bd99-44c1-85f6-6b13df2297a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d947a683-bd99-44c1-85f6-6b13df2297a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1628ebeb-62ac-44bd-b7b4-825f23d60e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1628ebeb-62ac-44bd-b7b4-825f23d60e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3800c723-1a8d-400d-9a06-00c4ec52991f', 'volume_name': 'volume-3800c723-1a8d-400d-9a06-00c4ec52991f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2b1d2b-08d5-4b2c-b772-7247c26172bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2b1d2b-08d5-4b2c-b772-7247c26172bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cc3e0f-465f-47ee-99d6-ec423a708b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Volume 3800c723-1a8d-400d-9a06-00c4ec52991f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3800c723-1a8d-400d-9a06-00c4ec52991f', 'volume_size': 1} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Flow 'volume_create_manager' (e1849216-1c02-44d0-a332-34c3824ac2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c1ae6d-bca9-483c-88b6-34d321ba1231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c1ae6d-bca9-483c-88b6-34d321ba1231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-920666252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d81f0e-ea48-42c4-92b8-97c42342eddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5b1b163c24dd184177b6694a30259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:28Z,use_quota=True,user_id='1f418e8020684ead9d865b57618fd281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccab4cb-6b66-4913-a5df-435df3d5a4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ccab4cb-6b66-4913-a5df-435df3d5a4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3466dd12-1bb5-49f7-8dd2-5f4fb4c02c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3466dd12-1bb5-49f7-8dd2-5f4fb4c02c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d81f0e-ea48-42c4-92b8-97c42342eddc', 'volume_name': 'volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a189c1c8-b8bd-41cc-bcf8-cc7e855c28fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a189c1c8-b8bd-41cc-bcf8-cc7e855c28fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63eea1c-668d-46bb-bf2d-98032f8e3433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Volume a5d81f0e-ea48-42c4-92b8-97c42342eddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc', 'volume_size': 1} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Flow 'volume_create_manager' (96f93e7a-fda0-4187-8b1e-7cf3b44376b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8d1fac-eadd-46a5-a16c-abb84d269b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad8d1fac-eadd-46a5-a16c-abb84d269b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1564838294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923e8120-ab2a-4654-a7ec-8b06e84d8688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aafa0c7e6439ab45af8734b257c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:28Z,use_quota=True,user_id='4e68e1874ab943cf9d82725e3c909323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b279f3-2cab-4d65-88c8-0f40c18da73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b279f3-2cab-4d65-88c8-0f40c18da73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdd47a1-5c68-4c7c-8ad6-78e5a4d83a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdd47a1-5c68-4c7c-8ad6-78e5a4d83a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '923e8120-ab2a-4654-a7ec-8b06e84d8688', 'volume_name': 'volume-923e8120-ab2a-4654-a7ec-8b06e84d8688', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac98539-06b9-4ec1-94d5-80ea9bbdf5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac98539-06b9-4ec1-94d5-80ea9bbdf5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa22cff-745c-4350-9516-18a270ba18c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume 923e8120-ab2a-4654-a7ec-8b06e84d8688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-923e8120-ab2a-4654-a7ec-8b06e84d8688', 'volume_size': 1} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Flow 'volume_create_manager' (53c9c8f3-f11f-4f6b-b525-d3c044350f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781bef78-fab0-4af4-9a9b-a77be63a1875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781bef78-fab0-4af4-9a9b-a77be63a1875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-778180780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d592bd8-e926-4ce5-b21b-7f1a358c5274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5b1b163c24dd184177b6694a30259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:28Z,use_quota=True,user_id='1f418e8020684ead9d865b57618fd281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17773ae-1102-4606-a8d9-8173de159ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f17773ae-1102-4606-a8d9-8173de159ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac80dd3c-b6eb-4986-8ed5-6b3eeb1f3c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac80dd3c-b6eb-4986-8ed5-6b3eeb1f3c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d592bd8-e926-4ce5-b21b-7f1a358c5274', 'volume_name': 'volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd4f694-00b0-477c-a8c6-c36be44ae03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd4f694-00b0-477c-a8c6-c36be44ae03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26940197-434e-43a7-af3d-9c43f09d93cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Volume 2d592bd8-e926-4ce5-b21b-7f1a358c5274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274', 'volume_size': 1} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Flow 'volume_create_manager' (3381caef-1c8e-478a-aca4-74aa18ddcf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e79b90-a423-40c9-8223-58ae1fa05491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e79b90-a423-40c9-8223-58ae1fa05491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-293703215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81304b7c-c266-47aa-8273-64daab013898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5b1b163c24dd184177b6694a30259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:29Z,use_quota=True,user_id='1f418e8020684ead9d865b57618fd281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b643a435-9c40-457a-8981-018dc213a8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b643a435-9c40-457a-8981-018dc213a8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2eae66-979b-420f-a082-233ac346c44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2eae66-979b-420f-a082-233ac346c44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81304b7c-c266-47aa-8273-64daab013898', 'volume_name': 'volume-81304b7c-c266-47aa-8273-64daab013898', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b973dd-7fcd-438a-b316-a58bdf69dffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b973dd-7fcd-438a-b316-a58bdf69dffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d79753-7c3b-454c-914b-ae6beaa01a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:28 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Volume 81304b7c-c266-47aa-8273-64daab013898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81304b7c-c266-47aa-8273-64daab013898', 'volume_size': 1} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:28 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 1073741824" returned: 0 in 0.961s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:29 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 Feb 26 20:36:29 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Flow 'volume_create_manager' (f3449707-2efc-4a19-8288-6be20aa61523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a436997e-3e50-4a42-9eb1-432d95c7a1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a436997e-3e50-4a42-9eb1-432d95c7a1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1429038335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b26a84e-6755-4e0d-83ea-5957da72948c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5b1b163c24dd184177b6694a30259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:29Z,use_quota=True,user_id='1f418e8020684ead9d865b57618fd281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0fa03f-9eec-4ed9-a93d-832f9fa7ce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0fa03f-9eec-4ed9-a93d-832f9fa7ce94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88d2a7b-d053-498d-bb73-fe708ec4d549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d88d2a7b-d053-498d-bb73-fe708ec4d549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b26a84e-6755-4e0d-83ea-5957da72948c', 'volume_name': 'volume-3b26a84e-6755-4e0d-83ea-5957da72948c', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c3770b-ed29-49c4-af18-5530434c04fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c3770b-ed29-49c4-af18-5530434c04fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5cb163-2d74-44d3-9079-35da66bb31ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:29 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Volume 3b26a84e-6755-4e0d-83ea-5957da72948c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b26a84e-6755-4e0d-83ea-5957da72948c', 'volume_size': 1} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:29 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688" returned: 0 in 0.491s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.331s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1091942397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3800c723-1a8d-400d-9a06-00c4ec52991f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5b1b163c24dd184177b6694a30259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:28Z,use_quota=True,user_id='1f418e8020684ead9d865b57618fd281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Creating volume 3800c723-1a8d-400d-9a06-00c4ec52991f {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:29 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3800c723-1a8d-400d-9a06-00c4ec52991f 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b65b0f-14b1-4781-a15e-56a471dadc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a0b9f0-fe5f-41c0-b4f3-c4c18b72aac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:29 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Volume volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 (dcfc5ee6-690a-4e02-a498-99ecb50f6688): created successfully Feb 26 20:36:29 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3800c723-1a8d-400d-9a06-00c4ec52991f 1073741824 Feb 26 20:36:29 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3a0b9f0-fe5f-41c0-b4f3-c4c18b72aac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Flow 'volume_create_manager' (7e22372a-f384-4e4d-b9ab-03f9c0f1744c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:29 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-222b923e-fe68-4bbb-a675-3998c67d9c03 tempest-VolumeDependencyTests-560135568 None] Created volume successfully. Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:30 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3800c723-1a8d-400d-9a06-00c4ec52991f 1073741824" returned: 0 in 0.706s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3800c723-1a8d-400d-9a06-00c4ec52991f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:30 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3800c723-1a8d-400d-9a06-00c4ec52991f Feb 26 20:36:30 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:30 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3800c723-1a8d-400d-9a06-00c4ec52991f" returned: 0 in 0.541s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.471s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-920666252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d81f0e-ea48-42c4-92b8-97c42342eddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5b1b163c24dd184177b6694a30259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:28Z,use_quota=True,user_id='1f418e8020684ead9d865b57618fd281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Creating volume a5d81f0e-ea48-42c4-92b8-97c42342eddc {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:30 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0cc3e0f-465f-47ee-99d6-ec423a708b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3800c723-1a8d-400d-9a06-00c4ec52991f', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6009c66-0476-43a4-8666-b6e69bcc4865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:30 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc 1073741824 Feb 26 20:36:30 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:30 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Volume volume-3800c723-1a8d-400d-9a06-00c4ec52991f (3800c723-1a8d-400d-9a06-00c4ec52991f): created successfully Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6009c66-0476-43a4-8666-b6e69bcc4865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:30 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Flow 'volume_create_manager' (06034d36-3121-4e94-8579-a61fc0a0eb8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:30 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c1811920-540a-4d9f-948f-d1a63b68b5e2 tempest-CreateVolumesFromImageTest-63130702 None] Created volume successfully. Feb 26 20:36:31 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc 1073741824" returned: 0 in 0.765s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:31 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc Feb 26 20:36:31 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:32 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc" returned: 0 in 0.556s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.634s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1564838294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923e8120-ab2a-4654-a7ec-8b06e84d8688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aafa0c7e6439ab45af8734b257c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:28Z,use_quota=True,user_id='4e68e1874ab943cf9d82725e3c909323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Creating volume 923e8120-ab2a-4654-a7ec-8b06e84d8688 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:32 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63eea1c-668d-46bb-bf2d-98032f8e3433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2937e60-2fcc-46d3-898c-eed5f2060a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:32 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Volume volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc (a5d81f0e-ea48-42c4-92b8-97c42342eddc): created successfully Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2937e60-2fcc-46d3-898c-eed5f2060a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:32 devstack sudo[91118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 1073741824 Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Flow 'volume_create_manager' (e1849216-1c02-44d0-a332-34c3824ac2ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:32 devstack sudo[91118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:32 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-6df47590-ac30-40fc-b79d-acfcd8814868 tempest-CreateVolumesFromImageTest-63130702 None] Created volume successfully. Feb 26 20:36:32 devstack sudo[91118]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 1073741824" returned: 0 in 0.675s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:32 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 Feb 26 20:36:32 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:33 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688" returned: 0 in 0.538s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.804s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-778180780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d592bd8-e926-4ce5-b21b-7f1a358c5274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5b1b163c24dd184177b6694a30259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:28Z,use_quota=True,user_id='1f418e8020684ead9d865b57618fd281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Creating volume 2d592bd8-e926-4ce5-b21b-7f1a358c5274 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:33 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa22cff-745c-4350-9516-18a270ba18c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923e8120-ab2a-4654-a7ec-8b06e84d8688', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0e15b2-ee36-4aa5-970d-50120c76e951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:33 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274 1073741824 Feb 26 20:36:33 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:33 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 (923e8120-ab2a-4654-a7ec-8b06e84d8688): created successfully Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0e15b2-ee36-4aa5-970d-50120c76e951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Flow 'volume_create_manager' (96f93e7a-fda0-4187-8b1e-7cf3b44376b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:33 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-73d54bb2-d155-492a-b126-c5dca4144ed0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created volume successfully. Feb 26 20:36:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:34 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274 1073741824" returned: 0 in 0.685s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:34 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274 Feb 26 20:36:34 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:34 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274" returned: 0 in 0.510s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.788s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-293703215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81304b7c-c266-47aa-8273-64daab013898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5b1b163c24dd184177b6694a30259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:29Z,use_quota=True,user_id='1f418e8020684ead9d865b57618fd281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Creating volume 81304b7c-c266-47aa-8273-64daab013898 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:34 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-81304b7c-c266-47aa-8273-64daab013898 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:34 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-81304b7c-c266-47aa-8273-64daab013898 1073741824 Feb 26 20:36:34 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26940197-434e-43a7-af3d-9c43f09d93cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855ef6f7-b04c-4c9a-9c2d-10d0d7e81a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:34 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Volume volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274 (2d592bd8-e926-4ce5-b21b-7f1a358c5274): created successfully Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (855ef6f7-b04c-4c9a-9c2d-10d0d7e81a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:34 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Flow 'volume_create_manager' (53c9c8f3-f11f-4f6b-b525-d3c044350f34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:34 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b343dbad-eb0e-4e64-95e1-3a32c3e6ec97 tempest-CreateVolumesFromImageTest-63130702 None] Created volume successfully. Feb 26 20:36:35 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-81304b7c-c266-47aa-8273-64daab013898 1073741824" returned: 0 in 0.606s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-81304b7c-c266-47aa-8273-64daab013898 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:36 devstack sudo[91139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-81304b7c-c266-47aa-8273-64daab013898 Feb 26 20:36:36 devstack sudo[91139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:36 devstack sudo[91139]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-81304b7c-c266-47aa-8273-64daab013898" returned: 0 in 0.469s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.643s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1429038335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b26a84e-6755-4e0d-83ea-5957da72948c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99e5b1b163c24dd184177b6694a30259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:29Z,use_quota=True,user_id='1f418e8020684ead9d865b57618fd281',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Creating volume 3b26a84e-6755-4e0d-83ea-5957da72948c {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:36 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3b26a84e-6755-4e0d-83ea-5957da72948c 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:36 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3b26a84e-6755-4e0d-83ea-5957da72948c 1073741824 Feb 26 20:36:36 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d79753-7c3b-454c-914b-ae6beaa01a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81304b7c-c266-47aa-8273-64daab013898', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ac3e21-0678-4e81-9490-e81f8a2aa122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:36 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Volume volume-81304b7c-c266-47aa-8273-64daab013898 (81304b7c-c266-47aa-8273-64daab013898): created successfully Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ac3e21-0678-4e81-9490-e81f8a2aa122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:36 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Flow 'volume_create_manager' (3381caef-1c8e-478a-aca4-74aa18ddcf66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:37 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7722d3b0-ba80-4e60-9991-bec207653eb3 tempest-CreateVolumesFromImageTest-63130702 None] Created volume successfully. Feb 26 20:36:37 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3b26a84e-6755-4e0d-83ea-5957da72948c 1073741824" returned: 0 in 0.608s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3b26a84e-6755-4e0d-83ea-5957da72948c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:38 devstack sudo[91147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3b26a84e-6755-4e0d-83ea-5957da72948c Feb 26 20:36:38 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:39 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3b26a84e-6755-4e0d-83ea-5957da72948c" returned: 0 in 0.453s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.377s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.025s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:INSERT=21,cinder:UPDATE=88,cinder:SELECT=62,cinder:DELETE=7 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] Creating offline snapshot 22f54195-7de5-416b-9bdb-d6fc8a130283 of volume dcfc5ee6-690a-4e02-a498-99ecb50f6688 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5cb163-2d74-44d3-9079-35da66bb31ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b26a84e-6755-4e0d-83ea-5957da72948c', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1defebe0-1cc8-4074-9d7d-a7c486607430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cc11a5-0d8e-4dfe-9932-48c8d267a2bd]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:39 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Volume volume-3b26a84e-6755-4e0d-83ea-5957da72948c (3b26a84e-6755-4e0d-83ea-5957da72948c): created successfully Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1defebe0-1cc8-4074-9d7d-a7c486607430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Flow 'volume_create_manager' (f3449707-2efc-4a19-8288-6be20aa61523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:39 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-58767946-f343-4368-ad9f-8094f732b484 tempest-CreateVolumesFromImageTest-63130702 None] Created volume successfully. Feb 26 20:36:39 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 Feb 26 20:36:39 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:39 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "cinder-3b26a84e-6755-4e0d-83ea-5957da72948c-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688" returned: 0 in 0.700s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-3b26a84e-6755-4e0d-83ea-5957da72948c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:39 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 1G Feb 26 20:36:39 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "cinder-quobyte-3b26a84e-6755-4e0d-83ea-5957da72948c" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:40 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-quobyte-3b26a84e-6755-4e0d-83ea-5957da72948c" acquired by "delete_volume" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:40 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c696705b-280e-4c66-a73c-01de23b8360b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3b26a84e-6755-4e0d-83ea-5957da72948c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:40 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3b26a84e-6755-4e0d-83ea-5957da72948c Feb 26 20:36:40 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:40 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 1G" returned: 0 in 0.634s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:40 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 Feb 26 20:36:40 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:40 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3b26a84e-6755-4e0d-83ea-5957da72948c" returned: 0 in 0.570s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3b26a84e-6755-4e0d-83ea-5957da72948c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:40 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3b26a84e-6755-4e0d-83ea-5957da72948c Feb 26 20:36:40 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:41 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283" returned: 0 in 0.516s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:41 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 is being set with open permissions: ugo+rw Feb 26 20:36:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:41 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 Feb 26 20:36:41 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:41 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3b26a84e-6755-4e0d-83ea-5957da72948c" returned: 0 in 0.512s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-quobyte-3b26a84e-6755-4e0d-83ea-5957da72948c" released by "delete_volume" :: held 1.120s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:41 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283" returned: 0 in 0.519s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:42 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Created reservations ['76333c7e-c65b-4375-a3be-d195f5417356', '9ba2c88b-4705-47ac-8731-73232d198e55', '3d4953ab-3678-46e5-814b-b34ac6255fb1', '7053608d-d0c9-4dee-97b6-123ab6e80f68'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:36:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:42 devstack sudo[91184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.info Feb 26 20:36:42 devstack sudo[91184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:42 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:42 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:42 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:36:42 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:43 devstack sudo[91184]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.info" returned: 0 in 0.578s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:43 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.info is being set with open permissions: ugo+rw Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:43 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.info Feb 26 20:36:43 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:43 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.536s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:36:43 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Deleted volume successfully. Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-bd3a3d4b-6de9-44cb-b757-2cacaca1d207 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-3b26a84e-6755-4e0d-83ea-5957da72948c-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "cinder-81304b7c-c266-47aa-8273-64daab013898-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-81304b7c-c266-47aa-8273-64daab013898-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:43 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.info" returned: 0 in 0.537s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.500s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.906s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "cinder-quobyte-81304b7c-c266-47aa-8273-64daab013898" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Creating offline snapshot e1781924-961c-409c-8737-c6d0143f39d9 of volume 923e8120-ab2a-4654-a7ec-8b06e84d8688 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:36:43 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e1fe488c-5e93-42c9-813d-7752de3d5287 tempest-VolumeDependencyTests-560135568 None] Create snapshot completed successfully Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-quobyte-81304b7c-c266-47aa-8273-64daab013898" acquired by "delete_volume" :: waited 0.019s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[5232c01d-638d-47e2-b217-1b87b6594e40]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcb987a-9849-4bd5-8200-7226b4295f69]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-81304b7c-c266-47aa-8273-64daab013898 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:43 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 Feb 26 20:36:43 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:43 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-81304b7c-c266-47aa-8273-64daab013898 Feb 26 20:36:43 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:44 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688" returned: 0 in 0.583s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:44 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-81304b7c-c266-47aa-8273-64daab013898" returned: 0 in 0.577s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-81304b7c-c266-47aa-8273-64daab013898 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:44 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 1G Feb 26 20:36:44 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:44 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-81304b7c-c266-47aa-8273-64daab013898 Feb 26 20:36:44 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:44 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:44 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-81304b7c-c266-47aa-8273-64daab013898" returned: 0 in 0.596s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:44 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-quobyte-81304b7c-c266-47aa-8273-64daab013898" released by "delete_volume" :: held 1.215s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:44 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Created reservations ['e4beea86-7091-468d-8883-8ff71eaf9474', '91f327db-ec00-40a8-990c-1789ba933905', 'ed42088a-7437-4132-ab87-0698849eec49', 'bcc1af9f-76e8-4571-bf7c-c0e09c670bb5'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:36:45 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 1G" returned: 0 in 0.696s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:45 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 Feb 26 20:36:45 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:45 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:36:45 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Flow 'volume_create_manager' (12b66426-c5aa-4cc9-a170-486f6b58c1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15589c70-0c46-43d9-8a28-4f221940f26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15589c70-0c46-43d9-8a28-4f221940f26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-641792712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c17b86-bd7d-489e-b8b9-0a7167edc71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4301cc1ac33c426185232bafd7a6197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=22f54195-7de5-416b-9bdb-d6fc8a130283,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:45Z,use_quota=True,user_id='ccde577a9edc45199e5a79f40850ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea07bea2-a972-48ea-9618-a1d78d2fa1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea07bea2-a972-48ea-9618-a1d78d2fa1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d000fad-f266-4e1a-a697-4a5d616ddc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d000fad-f266-4e1a-a697-4a5d616ddc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '41c17b86-bd7d-489e-b8b9-0a7167edc71f', 'volume_name': 'volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f', 'volume_size': 1, 'snapshot_id': '22f54195-7de5-416b-9bdb-d6fc8a130283'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19107d85-abeb-406f-a275-4832d6eca8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19107d85-abeb-406f-a275-4832d6eca8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d0c3a7-4570-4e76-8cf1-0be74cd5697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:45 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Volume 41c17b86-bd7d-489e-b8b9-0a7167edc71f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f', 'volume_size': 1, 'snapshot_id': '22f54195-7de5-416b-9bdb-d6fc8a130283'} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:45 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.571s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:36:45 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Deleted volume successfully. Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-92703f2d-b07c-4821-9b92-bfa2351940c1 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-81304b7c-c266-47aa-8273-64daab013898-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:45 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9" returned: 0 in 0.760s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:45 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 is being set with open permissions: ugo+rw Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:45 devstack sudo[91220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 Feb 26 20:36:45 devstack sudo[91220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "cinder-2d592bd8-e926-4ce5-b21b-7f1a358c5274-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-2d592bd8-e926-4ce5-b21b-7f1a358c5274-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "cinder-quobyte-2d592bd8-e926-4ce5-b21b-7f1a358c5274" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-quobyte-2d592bd8-e926-4ce5-b21b-7f1a358c5274" acquired by "delete_volume" :: waited 0.013s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a415567-9988-4d3c-b0f3-3a119c8e7d71]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:45 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:46 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274 Feb 26 20:36:46 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:46 devstack sudo[91220]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9" returned: 0 in 0.545s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:46 devstack sudo[91225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.info Feb 26 20:36:46 devstack sudo[91225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:46 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274" returned: 0 in 0.733s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:46 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274 Feb 26 20:36:46 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:46 devstack sudo[91225]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.info" returned: 0 in 0.500s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:46 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.info is being set with open permissions: ugo+rw Feb 26 20:36:46 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:46 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.info Feb 26 20:36:46 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:47 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-2d592bd8-e926-4ce5-b21b-7f1a358c5274" returned: 0 in 0.536s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-quobyte-2d592bd8-e926-4ce5-b21b-7f1a358c5274" released by "delete_volume" :: held 1.301s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Created reservations ['2fc5eacc-dd2a-49f1-990f-3df8ef5fad65', 'bc0efe9f-bc9f-4979-8cb1-0e33e1338fdf', '3169c7b9-4fcc-4069-a394-1ace45c3699c', '26185270-6bc9-4272-9dc3-e680b27eff67'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:47 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:36:47 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:47 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.info" returned: 0 in 0.667s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.860s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.269s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-quobyte-22f54195-7de5-416b-9bdb-d6fc8a130283-41c17b86-bd7d-489e-b8b9-0a7167edc71f" by "_create_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:47 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-8c99b69f-870a-4442-8f74-9530e94b0c08 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Create snapshot completed successfully Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-22f54195-7de5-416b-9bdb-d6fc8a130283-41c17b86-bd7d-489e-b8b9-0a7167edc71f" acquired by "_create_volume_from_snapshot" :: waited 0.058s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Creating volume 41c17b86-bd7d-489e-b8b9-0a7167edc71f from snapshot 22f54195-7de5-416b-9bdb-d6fc8a130283 {{(pid=83352) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-quobyte-41c17b86-bd7d-489e-b8b9-0a7167edc71f" by "_copy_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-41c17b86-bd7d-489e-b8b9-0a7167edc71f" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] snapshot: 22f54195-7de5-416b-9bdb-d6fc8a130283, volume: 41c17b86-bd7d-489e-b8b9-0a7167edc71f, {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[15851166-e52c-4641-8459-8ed5e75e55ed]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:47 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 Feb 26 20:36:47 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:47 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.591s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:36:47 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Deleted volume successfully. Feb 26 20:36:47 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-93bc42c3-0729-4089-9fe1-62a2f100356d tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-2d592bd8-e926-4ce5-b21b-7f1a358c5274-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "cinder-a5d81f0e-ea48-42c4-92b8-97c42342eddc-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-a5d81f0e-ea48-42c4-92b8-97c42342eddc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "cinder-quobyte-a5d81f0e-ea48-42c4-92b8-97c42342eddc" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-quobyte-a5d81f0e-ea48-42c4-92b8-97c42342eddc" acquired by "delete_volume" :: waited 0.019s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[88339dc3-d84e-4555-8e16-740dd5165cff]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:48 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc Feb 26 20:36:48 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:48 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283" returned: 0 in 0.776s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Creating direct copy from snapshot {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e91354-a24b-458b-9822-0f5882536cc1]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:48 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 Feb 26 20:36:48 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Flow 'volume_create_manager' (d0e07d01-6142-40b3-b755-5b024c061529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975be644-8b01-4c94-bc6c-341583ef687e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975be644-8b01-4c94-bc6c-341583ef687e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-146903253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0812463c-6e0c-472a-ab5d-3324f1ad5b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aafa0c7e6439ab45af8734b257c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:49Z,use_quota=True,user_id='4e68e1874ab943cf9d82725e3c909323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03de93c0-01da-4252-98e9-154138269be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03de93c0-01da-4252-98e9-154138269be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543c1c82-e38e-4e97-a477-ee82e32f47ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (543c1c82-e38e-4e97-a477-ee82e32f47ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0812463c-6e0c-472a-ab5d-3324f1ad5b42', 'volume_name': 'volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba617aa8-feac-476e-afc0-260196d3f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba617aa8-feac-476e-afc0-260196d3f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da61a940-08f9-4311-9f35-b359b625a635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:48 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume 0812463c-6e0c-472a-ab5d-3324f1ad5b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42', 'volume_size': 1} Feb 26 20:36:48 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Flow 'volume_create_manager' (f1069f3a-8b24-42f5-bd8a-232c0d90aa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131ea500-bb22-4215-802d-9f67078eb7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc" returned: 0 in 1.040s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (131ea500-bb22-4215-802d-9f67078eb7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-106304287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aafa0c7e6439ab45af8734b257c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:49Z,use_quota=True,user_id='4e68e1874ab943cf9d82725e3c909323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:49 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc Feb 26 20:36:49 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de85160-24dc-47d1-b095-77478c5d11cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7de85160-24dc-47d1-b095-77478c5d11cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c407a1ae-947c-483c-b2ea-80a8e12eeeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c407a1ae-947c-483c-b2ea-80a8e12eeeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3cba9e3-4ed2-4cd3-911d-25c46cb1f2df', 'volume_name': 'volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275b6b26-fa75-42ca-95e2-d6341fc28f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275b6b26-fa75-42ca-95e2-d6341fc28f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5178c24-f75e-4aae-9a2f-18e18a8e78ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df', 'volume_size': 1} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:49 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688" returned: 0 in 1.034s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.utils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Path /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f not found in is_blk_device check {{(pid=83352) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:49 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f Feb 26 20:36:49 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Flow 'volume_create_manager' (e6acd9f7-cb87-46b7-b99b-6aba94e7f5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093da606-bdfa-4e1b-a724-4668ca4e24b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (093da606-bdfa-4e1b-a724-4668ca4e24b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-552774218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e66746f-f8db-4322-93c1-415329bb5971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aafa0c7e6439ab45af8734b257c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:49Z,use_quota=True,user_id='4e68e1874ab943cf9d82725e3c909323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527d2acc-8427-4546-be47-cbcfad24b411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (527d2acc-8427-4546-be47-cbcfad24b411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58c3d3b-38b0-4eb9-bac1-31c9b43e4382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a58c3d3b-38b0-4eb9-bac1-31c9b43e4382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e66746f-f8db-4322-93c1-415329bb5971', 'volume_name': 'volume-5e66746f-f8db-4322-93c1-415329bb5971', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a29f1d-0683-42e3-b949-e39f262f9dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a29f1d-0683-42e3-b949-e39f262f9dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16dfa19-33fc-43d6-84ce-27fbd6b24177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume 5e66746f-f8db-4322-93c1-415329bb5971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e66746f-f8db-4322-93c1-415329bb5971', 'volume_size': 1} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Flow 'volume_create_manager' (cef9fcfd-36bc-40f4-92dc-b9109db1d9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1e1266-7298-4ace-939f-26327788fac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf1e1266-7298-4ace-939f-26327788fac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-984297962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ed2ed0-8d45-463e-862e-9b1178b497aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aafa0c7e6439ab45af8734b257c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:50Z,use_quota=True,user_id='4e68e1874ab943cf9d82725e3c909323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d108962a-ba08-4de2-ab70-93d8e5079564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d108962a-ba08-4de2-ab70-93d8e5079564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d966281-4900-438f-8778-2b438304b6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d966281-4900-438f-8778-2b438304b6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ed2ed0-8d45-463e-862e-9b1178b497aa', 'volume_name': 'volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa9e556-0aaa-477b-a5ba-d9eb183f48b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa9e556-0aaa-477b-a5ba-d9eb183f48b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e42efd0-86d7-4042-b37b-ffe8124808c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:49 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume e2ed2ed0-8d45-463e-862e-9b1178b497aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa', 'volume_size': 1} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:49 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-a5d81f0e-ea48-42c4-92b8-97c42342eddc" returned: 0 in 0.684s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:49 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-quobyte-a5d81f0e-ea48-42c4-92b8-97c42342eddc" released by "delete_volume" :: held 1.754s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Created reservations ['dea5a5e9-ffc1-4065-b2fb-2cd75b311cdf', 'b3fa5e98-e644-441a-b00e-0e34936debe9', 'd36ddc9f-b7ac-4f59-8f7b-d2d900d1771d', '00845467-7a16-4357-bfd1-b6fc9a5176cf'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:50 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:36:50 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Flow 'volume_create_manager' (93d42443-ccaf-467d-b10c-858664980e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7bb4501-84ad-45a2-b21e-44881cd7b669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7bb4501-84ad-45a2-b21e-44881cd7b669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1578000193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19918e34-ca12-49fc-8da3-c4abec88e945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aafa0c7e6439ab45af8734b257c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:50Z,use_quota=True,user_id='4e68e1874ab943cf9d82725e3c909323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66100449-94a8-4424-a1cd-b56fd3cdd51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66100449-94a8-4424-a1cd-b56fd3cdd51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18eb23c5-eccd-4716-9487-32e09127ea47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18eb23c5-eccd-4716-9487-32e09127ea47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19918e34-ca12-49fc-8da3-c4abec88e945', 'volume_name': 'volume-19918e34-ca12-49fc-8da3-c4abec88e945', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8aab74f-2ab5-4859-9c92-15eba6f5285e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8aab74f-2ab5-4859-9c92-15eba6f5285e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ed14c0-28a6-45fc-9aed-4574cf74d4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:50 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume 19918e34-ca12-49fc-8da3-c4abec88e945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19918e34-ca12-49fc-8da3-c4abec88e945', 'volume_size': 1} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "cinder-3800c723-1a8d-400d-9a06-00c4ec52991f-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-3800c723-1a8d-400d-9a06-00c4ec52991f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:UPDATE=113,cinder:SELECT=93,cinder:INSERT=30,cinder:DELETE=10 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "cinder-quobyte-3800c723-1a8d-400d-9a06-00c4ec52991f" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-quobyte-3800c723-1a8d-400d-9a06-00c4ec52991f" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ed1816-9dab-4e2f-8cb5-8dee908f98ab]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:50 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3800c723-1a8d-400d-9a06-00c4ec52991f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:51 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3800c723-1a8d-400d-9a06-00c4ec52991f Feb 26 20:36:51 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:51 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:51 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 1.589s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:51 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:36:51 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Deleted volume successfully. Feb 26 20:36:51 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-5705f457-6df3-452a-99d1-ed83ab41b137 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-a5d81f0e-ea48-42c4-92b8-97c42342eddc-delete_volume" released by "delete_volume" :: held 3.693s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:52 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f" returned: 0 in 2.836s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:52 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a7a957-b2d6-4d39-854b-8bae6fd65e9f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:52 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 Feb 26 20:36:52 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:52 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3800c723-1a8d-400d-9a06-00c4ec52991f" returned: 0 in 1.618s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:52 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3800c723-1a8d-400d-9a06-00c4ec52991f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:52 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3800c723-1a8d-400d-9a06-00c4ec52991f Feb 26 20:36:52 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:53 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688" returned: 0 in 0.884s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688, size 1024.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:36:53 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Converted 1024.00 MB image at 360.99 MB/s Feb 26 20:36:53 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f is being set with open permissions: ugo+rw Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:53 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f Feb 26 20:36:53 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:53 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3800c723-1a8d-400d-9a06-00c4ec52991f" returned: 0 in 0.670s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-quobyte-3800c723-1a8d-400d-9a06-00c4ec52991f" released by "delete_volume" :: held 2.336s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Created reservations ['61efb20d-4007-4d7d-8ec5-484c43672671', '1ac930e2-ac95-4ab9-9ceb-cd3bc4ccc7c2', 'b4b977cc-5e1c-47d9-9205-ab519b7480f0', '4b361939-2c26-4a8c-b64c-95530e78ede0'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:53 devstack sudo[91325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:36:53 devstack sudo[91325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:53 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Flow 'volume_create_manager' (d1d8c207-ea37-4fa0-a8ef-4d975c041194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589e41a3-bfb8-4b0f-91d9-ae6fdb49cccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f" returned: 0 in 0.521s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-41c17b86-bd7d-489e-b8b9-0a7167edc71f" released by "_copy_volume_from_snapshot" :: held 6.123s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-22f54195-7de5-416b-9bdb-d6fc8a130283-41c17b86-bd7d-489e-b8b9-0a7167edc71f" released by "_create_volume_from_snapshot" :: held 6.150s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.210s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.854s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-146903253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0812463c-6e0c-472a-ab5d-3324f1ad5b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aafa0c7e6439ab45af8734b257c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:49Z,use_quota=True,user_id='4e68e1874ab943cf9d82725e3c909323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Creating volume 0812463c-6e0c-472a-ab5d-3324f1ad5b42 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:53 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589e41a3-bfb8-4b0f-91d9-ae6fdb49cccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-133658222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8578d45a-7efd-41f1-bc2b-043485bb290b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec98ec9e5db0493d83509bd4835d0600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:54Z,use_quota=True,user_id='c75cc628eb5f4331858f8110a10e2adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:53 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42 1073741824 Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c054be91-6947-4da5-8f97-9707d2eb577e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:53 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c054be91-6947-4da5-8f97-9707d2eb577e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7189ebd-dbe3-46a9-82d8-4b1debd56441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7189ebd-dbe3-46a9-82d8-4b1debd56441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8578d45a-7efd-41f1-bc2b-043485bb290b', 'volume_name': 'volume-8578d45a-7efd-41f1-bc2b-043485bb290b', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8001d45-3496-4b6a-a27b-9475a17cde6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8001d45-3496-4b6a-a27b-9475a17cde6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582dc0b3-d632-487d-ad50-87cf2fd080a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:53 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Volume 8578d45a-7efd-41f1-bc2b-043485bb290b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8578d45a-7efd-41f1-bc2b-043485bb290b', 'volume_size': 1} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d0c3a7-4570-4e76-8cf1-0be74cd5697d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f', 'volume_size': 1, 'snapshot_id': '22f54195-7de5-416b-9bdb-d6fc8a130283'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebae443b-f301-4709-9990-50e3b4ed50b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:53 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Volume volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f (41c17b86-bd7d-489e-b8b9-0a7167edc71f): created successfully Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebae443b-f301-4709-9990-50e3b4ed50b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Flow 'volume_create_manager' (12b66426-c5aa-4cc9-a170-486f6b58c1ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:53 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-47e2a93b-a95f-496c-ab1b-6cfeab514eb0 tempest-VolumeDependencyTests-560135568 None] Created volume successfully. Feb 26 20:36:53 devstack sudo[91325]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.522s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:36:53 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Deleted volume successfully. Feb 26 20:36:53 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c6d9bb70-2f20-4053-9da8-ab6cb118f992 tempest-CreateVolumesFromImageTest-63130702 None] Lock "cinder-3800c723-1a8d-400d-9a06-00c4ec52991f-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-22f54195-7de5-416b-9bdb-d6fc8a130283-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-22f54195-7de5-416b-9bdb-d6fc8a130283-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-quobyte-dcfc5ee6-690a-4e02-a498-99ecb50f6688" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-dcfc5ee6-690a-4e02-a498-99ecb50f6688" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-quobyte-22f54195-7de5-416b-9bdb-d6fc8a130283" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-22f54195-7de5-416b-9bdb-d6fc8a130283" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Deleting offline snapshot 22f54195-7de5-416b-9bdb-d6fc8a130283 of volume dcfc5ee6-690a-4e02-a498-99ecb50f6688 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] snapshot_file for this snap is: volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[24949ede-6b2b-4618-aeb0-718703516498]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:54 devstack sudo[91334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 Feb 26 20:36:54 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:54 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42 1073741824" returned: 0 in 0.595s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:54 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42 Feb 26 20:36:54 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:54 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283" returned: 0 in 0.611s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f8181b-6ead-48b7-ab5b-1ae5ffd2ab48]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:54 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 Feb 26 20:36:54 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:54 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42" returned: 0 in 0.566s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.595s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-106304287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aafa0c7e6439ab45af8734b257c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:49Z,use_quota=True,user_id='4e68e1874ab943cf9d82725e3c909323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Creating volume d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:54 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:54 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da61a940-08f9-4311-9f35-b359b625a635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b2a24c-5e39-4c06-9703-b73d0fb23eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:55 devstack sudo[91344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df 1073741824 Feb 26 20:36:55 devstack sudo[91344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:55 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42 (0812463c-6e0c-472a-ab5d-3324f1ad5b42): created successfully Feb 26 20:36:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b2a24c-5e39-4c06-9703-b73d0fb23eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:55 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Flow 'volume_create_manager' (d0e07d01-6142-40b3-b755-5b024c061529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:55 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-4c93a800-2d3d-45b3-beb6-81dca4e61daa tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created volume successfully. Feb 26 20:36:55 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688" returned: 0 in 0.659s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:55 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 Feb 26 20:36:55 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:55 devstack sudo[91344]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df 1073741824" returned: 0 in 0.724s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:55 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df Feb 26 20:36:55 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:55 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283" returned: 0 in 0.555s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:55 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:56 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283 Feb 26 20:36:56 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:56 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df" returned: 0 in 0.509s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.510s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-552774218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e66746f-f8db-4322-93c1-415329bb5971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aafa0c7e6439ab45af8734b257c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:49Z,use_quota=True,user_id='4e68e1874ab943cf9d82725e3c909323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Creating volume 5e66746f-f8db-4322-93c1-415329bb5971 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:56 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5e66746f-f8db-4322-93c1-415329bb5971 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5178c24-f75e-4aae-9a2f-18e18a8e78ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:56 devstack sudo[91362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5e66746f-f8db-4322-93c1-415329bb5971 1073741824 Feb 26 20:36:56 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e469f6-9fd0-4be7-b84e-78b03d9786f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:56 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df (d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df): created successfully Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1e469f6-9fd0-4be7-b84e-78b03d9786f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Flow 'volume_create_manager' (f1069f3a-8b24-42f5-bd8a-232c0d90aa8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:56 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-eee5c9bc-46f6-4317-8966-4d8547c2b9f4 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created volume successfully. Feb 26 20:36:56 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688.22f54195-7de5-416b-9bdb-d6fc8a130283" returned: 0 in 0.503s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-22f54195-7de5-416b-9bdb-d6fc8a130283" released by "_delete_snapshot" :: held 2.403s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-dcfc5ee6-690a-4e02-a498-99ecb50f6688" released by "delete_snapshot" :: held 2.420s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Created reservations ['536be630-b823-4c3b-b6d3-dbb345d40b6b', '7d15983b-4d5f-40e2-92ba-510dc8dc46ea', 'a3f556ed-6ef9-4884-870b-edc9595d543e', '35df196c-efff-46f1-bd40-39f6662da21b'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Flow 'volume_create_manager' (ece44996-e573-43df-9b1f-e28e81c0c06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feea9229-288a-4eb4-8a75-2102a1a40a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feea9229-288a-4eb4-8a75-2102a1a40a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1105256201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194f56db-d83a-4f60-bf4a-cd9ce2665f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd6ed7b96f045a8929787e14605b5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:57Z,use_quota=True,user_id='45db87936747461a8a5eb9c134b3bc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40cc7e34-4e52-4215-822f-42c634d1bbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40cc7e34-4e52-4215-822f-42c634d1bbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbe7cf9-baeb-47e0-be97-11612b80ebb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bbe7cf9-baeb-47e0-be97-11612b80ebb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194f56db-d83a-4f60-bf4a-cd9ce2665f75', 'volume_name': 'volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6e7513-e736-4fdc-99e4-9e54e45890f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6e7513-e736-4fdc-99e4-9e54e45890f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41b4a89-0b06-4af7-bb99-5781a59e46ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:56 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume 194f56db-d83a-4f60-bf4a-cd9ce2665f75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75', 'volume_size': 1} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:56 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Delete snapshot completed successfully. Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-80e71539-c9fb-483a-8e09-f2d5bab69f52 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-22f54195-7de5-416b-9bdb-d6fc8a130283-delete_snapshot" released by "delete_snapshot" :: held 2.703s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:56 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5e66746f-f8db-4322-93c1-415329bb5971 1073741824" returned: 0 in 0.664s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:56 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5e66746f-f8db-4322-93c1-415329bb5971 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:57 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5e66746f-f8db-4322-93c1-415329bb5971 Feb 26 20:36:57 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-dcfc5ee6-690a-4e02-a498-99ecb50f6688-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Lock "cinder-dcfc5ee6-690a-4e02-a498-99ecb50f6688-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-quobyte-dcfc5ee6-690a-4e02-a498-99ecb50f6688" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-dcfc5ee6-690a-4e02-a498-99ecb50f6688" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3719f38-792e-4179-a7e2-9b755f9d7515]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:57 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5e66746f-f8db-4322-93c1-415329bb5971" returned: 0 in 0.551s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] <== create_volume: return (1284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.646s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-984297962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ed2ed0-8d45-463e-862e-9b1178b497aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aafa0c7e6439ab45af8734b257c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:50Z,use_quota=True,user_id='4e68e1874ab943cf9d82725e3c909323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Creating volume e2ed2ed0-8d45-463e-862e-9b1178b497aa {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:57 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16dfa19-33fc-43d6-84ce-27fbd6b24177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e66746f-f8db-4322-93c1-415329bb5971', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c051afce-1da1-4fbc-ac42-a3038b1ec2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:57 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa 1073741824 Feb 26 20:36:57 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:57 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume volume-5e66746f-f8db-4322-93c1-415329bb5971 (5e66746f-f8db-4322-93c1-415329bb5971): created successfully Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c051afce-1da1-4fbc-ac42-a3038b1ec2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:57 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 Feb 26 20:36:57 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:57 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Flow 'volume_create_manager' (e6acd9f7-cb87-46b7-b99b-6aba94e7f5ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:57 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-f390736e-e44e-4323-a133-d9f578bce906 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created volume successfully. Feb 26 20:36:58 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:58 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688" returned: 0 in 0.692s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa 1073741824" returned: 0 in 0.593s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:58 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688 Feb 26 20:36:58 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:58 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa Feb 26 20:36:58 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:58 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa" returned: 0 in 0.462s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.280s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1578000193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19918e34-ca12-49fc-8da3-c4abec88e945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aafa0c7e6439ab45af8734b257c95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:50Z,use_quota=True,user_id='4e68e1874ab943cf9d82725e3c909323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Creating volume 19918e34-ca12-49fc-8da3-c4abec88e945 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:58 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:58 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-19918e34-ca12-49fc-8da3-c4abec88e945 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-dcfc5ee6-690a-4e02-a498-99ecb50f6688" returned: 0 in 0.539s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:58 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-19918e34-ca12-49fc-8da3-c4abec88e945 1073741824 Feb 26 20:36:58 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e42efd0-86d7-4042-b37b-ffe8124808c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f1c0f4-0922-461e-9448-df0af6b353d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-dcfc5ee6-690a-4e02-a498-99ecb50f6688" released by "delete_volume" :: held 1.287s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:58 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa (e2ed2ed0-8d45-463e-862e-9b1178b497aa): created successfully Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f1c0f4-0922-461e-9448-df0af6b353d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Flow 'volume_create_manager' (cef9fcfd-36bc-40f4-92dc-b9109db1d9bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:58 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-89227121-65d7-4e26-bfbd-acddb54621f6 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created volume successfully. Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Created reservations ['8eba6600-4e2f-4811-92b0-2608528356d1', '42263fc3-0366-46f3-8722-ec277ab11c55', 'f2bfdde5-d68d-48e1-bf6a-b21ffcc41ad7', '924894db-01cb-4001-aea9-ad971262594f'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:58 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:58 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:36:58 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:59 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.453s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:36:59 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Deleted volume successfully. Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-e7b1cb58-92fd-427a-ae1d-a8b9437a7edd tempest-VolumeDependencyTests-560135568 None] Lock "cinder-dcfc5ee6-690a-4e02-a498-99ecb50f6688-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:36:59 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-19918e34-ca12-49fc-8da3-c4abec88e945 1073741824" returned: 0 in 0.674s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-19918e34-ca12-49fc-8da3-c4abec88e945 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:59 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-19918e34-ca12-49fc-8da3-c4abec88e945 Feb 26 20:36:59 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Flow 'volume_create_manager' (d1677fb7-bd3c-40cc-998f-0b77f9083028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13842d37-0d81-442a-bfb4-b33b36ae2942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13842d37-0d81-442a-bfb4-b33b36ae2942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1065503555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3344b5a6-5055-4817-bba5-314b8cb8ad13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4301cc1ac33c426185232bafd7a6197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:00Z,use_quota=True,user_id='ccde577a9edc45199e5a79f40850ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f88b14e-a52b-45cf-9fbc-3fd63c123fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f88b14e-a52b-45cf-9fbc-3fd63c123fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481840e7-80bf-480c-9162-7ee8b9a38fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481840e7-80bf-480c-9162-7ee8b9a38fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3344b5a6-5055-4817-bba5-314b8cb8ad13', 'volume_name': 'volume-3344b5a6-5055-4817-bba5-314b8cb8ad13', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bcf852-db26-4e55-b462-2a775d8c170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bcf852-db26-4e55-b462-2a775d8c170b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6818668-0523-43f4-b6f0-1316f7257d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:59 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Volume 3344b5a6-5055-4817-bba5-314b8cb8ad13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3344b5a6-5055-4817-bba5-314b8cb8ad13', 'volume_size': 1} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:59 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-19918e34-ca12-49fc-8da3-c4abec88e945" returned: 0 in 0.565s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.137s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-133658222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8578d45a-7efd-41f1-bc2b-043485bb290b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec98ec9e5db0493d83509bd4835d0600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:54Z,use_quota=True,user_id='c75cc628eb5f4331858f8110a10e2adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Creating volume 8578d45a-7efd-41f1-bc2b-043485bb290b {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:36:59 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ed14c0-28a6-45fc-9aed-4574cf74d4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19918e34-ca12-49fc-8da3-c4abec88e945', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:36:59 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b 1073741824 Feb 26 20:36:59 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2861c4-14f4-4b9e-8798-9da0bcf0da74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:36:59 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Volume volume-19918e34-ca12-49fc-8da3-c4abec88e945 (19918e34-ca12-49fc-8da3-c4abec88e945): created successfully Feb 26 20:36:59 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2861c4-14f4-4b9e-8798-9da0bcf0da74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:00 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Flow 'volume_create_manager' (93d42443-ccaf-467d-b10c-858664980e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:00 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-b766043b-d8fb-4096-9527-1c0454efd9ad tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created volume successfully. Feb 26 20:37:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-19918e34-ca12-49fc-8da3-c4abec88e945-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-19918e34-ca12-49fc-8da3-c4abec88e945-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-quobyte-19918e34-ca12-49fc-8da3-c4abec88e945" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:00 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-19918e34-ca12-49fc-8da3-c4abec88e945" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:00 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b17e47e-2be3-4a37-a0b1-47e1238e636d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-19918e34-ca12-49fc-8da3-c4abec88e945 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:00 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-19918e34-ca12-49fc-8da3-c4abec88e945 Feb 26 20:37:00 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:00 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b 1073741824" returned: 0 in 0.555s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:00 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b Feb 26 20:37:00 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:00 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-19918e34-ca12-49fc-8da3-c4abec88e945" returned: 0 in 0.649s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:00 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-19918e34-ca12-49fc-8da3-c4abec88e945 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:00 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-19918e34-ca12-49fc-8da3-c4abec88e945 Feb 26 20:37:00 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:01 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b" returned: 0 in 0.483s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.235s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1105256201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194f56db-d83a-4f60-bf4a-cd9ce2665f75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd6ed7b96f045a8929787e14605b5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:36:57Z,use_quota=True,user_id='45db87936747461a8a5eb9c134b3bc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Creating volume 194f56db-d83a-4f60-bf4a-cd9ce2665f75 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:37:01 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582dc0b3-d632-487d-ad50-87cf2fd080a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8578d45a-7efd-41f1-bc2b-043485bb290b', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4d505a-844f-4222-a60a-647f53f8ccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:01 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Volume volume-8578d45a-7efd-41f1-bc2b-043485bb290b (8578d45a-7efd-41f1-bc2b-043485bb290b): created successfully Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4d505a-844f-4222-a60a-647f53f8ccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Flow 'volume_create_manager' (d1d8c207-ea37-4fa0-a8ef-4d975c041194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:01 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75 1073741824 Feb 26 20:37:01 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:01 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3f40f673-b158-4b63-a1b9-f26ec17ce1b9 tempest-SnapshotDependencyTests-1556842265 None] Created volume successfully. Feb 26 20:37:01 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-19918e34-ca12-49fc-8da3-c4abec88e945" returned: 0 in 0.529s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-19918e34-ca12-49fc-8da3-c4abec88e945" released by "delete_volume" :: held 1.216s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created reservations ['ad9af49f-fb73-4ba3-8473-002b7bb6b756', '3f830ba1-a239-40ed-b7e5-f7c11e927a23', '476fb2d3-ae22-4972-a6d9-112e26393821', 'b0a32f02-ed94-4cd4-a4d2-3b32ae9e8123'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:01 devstack sudo[91420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:01 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:01 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75 1073741824" returned: 0 in 0.639s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:01 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:01 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75 Feb 26 20:37:01 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:02 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.490s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:02 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Deleted volume successfully. Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0a0ac54b-aa29-4ad1-a9d0-c317e9588bf0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-19918e34-ca12-49fc-8da3-c4abec88e945-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:02 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75" returned: 0 in 0.463s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.246s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1065503555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3344b5a6-5055-4817-bba5-314b8cb8ad13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4301cc1ac33c426185232bafd7a6197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:00Z,use_quota=True,user_id='ccde577a9edc45199e5a79f40850ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Creating volume 3344b5a6-5055-4817-bba5-314b8cb8ad13 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:37:02 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:02 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 1073741824 Feb 26 20:37:02 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41b4a89-0b06-4af7-bb99-5781a59e46ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae94d0d2-0e1a-4b6e-a1df-0bed10394657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:02 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75 (194f56db-d83a-4f60-bf4a-cd9ce2665f75): created successfully Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae94d0d2-0e1a-4b6e-a1df-0bed10394657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Flow 'volume_create_manager' (ece44996-e573-43df-9b1f-e28e81c0c06d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:02 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-269e64cd-6c5f-42eb-a8a7-3009590f1dfc tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Created volume successfully. Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-e2ed2ed0-8d45-463e-862e-9b1178b497aa-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-e2ed2ed0-8d45-463e-862e-9b1178b497aa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-quobyte-e2ed2ed0-8d45-463e-862e-9b1178b497aa" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-e2ed2ed0-8d45-463e-862e-9b1178b497aa" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30fdab7-c740-4462-87b2-b5a709109997]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:02 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa Feb 26 20:37:02 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:02 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 1073741824" returned: 0 in 0.619s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:02 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:02 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 Feb 26 20:37:02 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:03 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa" returned: 0 in 0.575s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:03 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa Feb 26 20:37:03 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Flow 'volume_create_manager' (92774a67-da0c-47ad-b191-a74225bd7543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbdf695-7023-4681-9dd7-27ce846c3a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbdf695-7023-4681-9dd7-27ce846c3a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1763684083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac022ee2-fa3f-48fd-81be-7cbad25f9a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd6ed7b96f045a8929787e14605b5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:03Z,use_quota=True,user_id='45db87936747461a8a5eb9c134b3bc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f303e7fb-0205-49b5-87a1-849571a9efc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f303e7fb-0205-49b5-87a1-849571a9efc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b0f032-7d4a-443b-b752-287bb4355e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b0f032-7d4a-443b-b752-287bb4355e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac022ee2-fa3f-48fd-81be-7cbad25f9a39', 'volume_name': 'volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc13adc-f38b-4de8-9512-53a70768b608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc13adc-f38b-4de8-9512-53a70768b608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f07cbc8-094d-443d-8bff-b2bcbe5fa7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:03 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume ac022ee2-fa3f-48fd-81be-7cbad25f9a39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39', 'volume_size': 1} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:03 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13" returned: 0 in 0.615s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.990s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] Creating offline snapshot 9f2e8637-754f-4daf-a608-b7d183820411 of volume 8578d45a-7efd-41f1-bc2b-043485bb290b {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6818668-0523-43f4-b6f0-1316f7257d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3344b5a6-5055-4817-bba5-314b8cb8ad13', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bf8c5f-5eb5-4ebb-9fde-0f409522dd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15943b6-8dc0-4ab5-ad20-6645137c041a]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:03 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Volume volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 (3344b5a6-5055-4817-bba5-314b8cb8ad13): created successfully Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bf8c5f-5eb5-4ebb-9fde-0f409522dd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Flow 'volume_create_manager' (d1677fb7-bd3c-40cc-998f-0b77f9083028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:03 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1549b842-5a93-4058-9f53-eba906d18be1 tempest-VolumeDependencyTests-560135568 None] Created volume successfully. Feb 26 20:37:03 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b Feb 26 20:37:03 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Flow 'volume_create_manager' (d120df6c-c874-42c3-abe1-49d4dbb38059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad53b937-b549-472c-80e9-6856924c75e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad53b937-b549-472c-80e9-6856924c75e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2049637353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8295da35-ff06-49ab-b6b1-66d7da669ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd6ed7b96f045a8929787e14605b5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:04Z,use_quota=True,user_id='45db87936747461a8a5eb9c134b3bc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d50a92-36eb-455a-a262-036e14ba764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d50a92-36eb-455a-a262-036e14ba764c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40270f72-536b-4662-b8a8-678573d387b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40270f72-536b-4662-b8a8-678573d387b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8295da35-ff06-49ab-b6b1-66d7da669ab5', 'volume_name': 'volume-8295da35-ff06-49ab-b6b1-66d7da669ab5', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9305f8f0-b5e4-4c3a-a514-3c0824fc4dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9305f8f0-b5e4-4c3a-a514-3c0824fc4dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e75e30-4a71-4a97-bbc0-2ec50c441e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:03 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume 8295da35-ff06-49ab-b6b1-66d7da669ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8295da35-ff06-49ab-b6b1-66d7da669ab5', 'volume_size': 1} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:03 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e2ed2ed0-8d45-463e-862e-9b1178b497aa" returned: 0 in 0.698s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-e2ed2ed0-8d45-463e-862e-9b1178b497aa" released by "delete_volume" :: held 1.304s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created reservations ['970a71a1-c980-4678-8726-70d872af182a', 'f457cff9-46f5-48e7-b475-d60ab7d75f4a', 'dfd9d28c-7570-42f5-b9b1-14fe85e2422e', 'e2add0a5-a022-44ba-ab83-36b5bbf7d022'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Flow 'volume_create_manager' (fc0b9ee2-2a4f-4d64-9d6e-480ea6b43e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4627de7f-1007-4755-9367-580c9377ee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:03 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4627de7f-1007-4755-9367-580c9377ee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1416492559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3d5440-3559-46df-8d5f-e42b899c5219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd6ed7b96f045a8929787e14605b5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:04Z,use_quota=True,user_id='45db87936747461a8a5eb9c134b3bc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a045dc88-2889-48f4-8a24-dfe1eabbd72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a045dc88-2889-48f4-8a24-dfe1eabbd72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb27c8a-dcf2-4bd0-890d-633e88af9b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb27c8a-dcf2-4bd0-890d-633e88af9b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa3d5440-3559-46df-8d5f-e42b899c5219', 'volume_name': 'volume-aa3d5440-3559-46df-8d5f-e42b899c5219', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:04 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a962827-6149-461a-a5bb-ed55e09d3ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a962827-6149-461a-a5bb-ed55e09d3ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a865014-8a8c-472c-a221-e9f749b0d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume aa3d5440-3559-46df-8d5f-e42b899c5219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa3d5440-3559-46df-8d5f-e42b899c5219', 'volume_size': 1} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:04 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b" returned: 0 in 0.740s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:04 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 1G Feb 26 20:37:04 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Flow 'volume_create_manager' (388b02c2-33d8-4cac-85a3-8aa2d95e29d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ea577d-2b6c-4c43-a727-b885c2d42787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ea577d-2b6c-4c43-a727-b885c2d42787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1301239585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93524fa-39a0-4bbd-9a1e-957e8327114d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd6ed7b96f045a8929787e14605b5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:04Z,use_quota=True,user_id='45db87936747461a8a5eb9c134b3bc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34740567-c2f7-437d-b6dc-928bc096d816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34740567-c2f7-437d-b6dc-928bc096d816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa332cdc-2142-4f1b-a64f-d58613e06e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa332cdc-2142-4f1b-a64f-d58613e06e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd93524fa-39a0-4bbd-9a1e-957e8327114d', 'volume_name': 'volume-d93524fa-39a0-4bbd-9a1e-957e8327114d', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f5cf9a-3674-4b19-b939-03fe5fb0be1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f5cf9a-3674-4b19-b939-03fe5fb0be1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1605d299-7336-4b22-8505-daaeaa173131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume d93524fa-39a0-4bbd-9a1e-957e8327114d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d93524fa-39a0-4bbd-9a1e-957e8327114d', 'volume_size': 1} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-5e66746f-f8db-4322-93c1-415329bb5971-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Flow 'volume_create_manager' (8c941cc1-bc9a-4a56-9bc8-f03b79742298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f7556a-db38-41c2-8a7f-2364f8ddc8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Flow 'volume_create_manager' (f7da619c-94cf-4487-95b1-91450f3a216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6e72c6-25d4-45d7-b07a-478a2da924f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6e72c6-25d4-45d7-b07a-478a2da924f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1141330605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abee5c7-0f3b-44a8-83a3-8dbe9db71f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd6ed7b96f045a8929787e14605b5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:05Z,use_quota=True,user_id='45db87936747461a8a5eb9c134b3bc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a15d9d-a75d-4432-86fa-642bfcbbe067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a15d9d-a75d-4432-86fa-642bfcbbe067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbc50d3-2400-41df-97c1-f9a8ee996fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbc50d3-2400-41df-97c1-f9a8ee996fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8abee5c7-0f3b-44a8-83a3-8dbe9db71f66', 'volume_name': 'volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa54296-db35-4726-b3e3-0c92aede4937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa54296-db35-4726-b3e3-0c92aede4937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902cc447-5b1e-468e-8079-ba10ffd746cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume 8abee5c7-0f3b-44a8-83a3-8dbe9db71f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66', 'volume_size': 1} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-5e66746f-f8db-4322-93c1-415329bb5971-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.848s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:04 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Deleted volume successfully. Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f7556a-db38-41c2-8a7f-2364f8ddc8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1111046739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d12fcd9-b6b5-4894-8487-2917256c2752,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4301cc1ac33c426185232bafd7a6197d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3344b5a6-5055-4817-bba5-314b8cb8ad13,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:05Z,use_quota=True,user_id='ccde577a9edc45199e5a79f40850ffb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bb145e-60d3-4dce-8209-7382f22420a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78bb145e-60d3-4dce-8209-7382f22420a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ade2325-4b6a-40dd-93e0-b8775d41653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ade2325-4b6a-40dd-93e0-b8775d41653b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7d12fcd9-b6b5-4894-8487-2917256c2752', 'volume_name': 'volume-7d12fcd9-b6b5-4894-8487-2917256c2752', 'volume_size': 1, 'source_volid': '3344b5a6-5055-4817-bba5-314b8cb8ad13', 'source_volstatus': 'available'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83e5952-ee25-4dfa-bafd-fd82f0845954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b83e5952-ee25-4dfa-bafd-fd82f0845954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3a7ac4-72a4-43ab-af35-d1e01412a82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:04 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Volume 7d12fcd9-b6b5-4894-8487-2917256c2752: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7d12fcd9-b6b5-4894-8487-2917256c2752', 'volume_size': 1, 'source_volid': '3344b5a6-5055-4817-bba5-314b8cb8ad13', 'source_volstatus': 'available'} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8099a92c-0edd-459d-bf20-4b1d7d9f8154 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-e2ed2ed0-8d45-463e-862e-9b1178b497aa-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-quobyte-5e66746f-f8db-4322-93c1-415329bb5971" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-5e66746f-f8db-4322-93c1-415329bb5971" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e8acf1-abc4-450b-9a27-05ea88222753]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5e66746f-f8db-4322-93c1-415329bb5971 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:04 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 1G" returned: 0 in 0.764s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:04 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8578d45a-7efd-41f1-bc2b-043485bb290b -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:05 devstack sudo[91458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8578d45a-7efd-41f1-bc2b-043485bb290b -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 Feb 26 20:37:05 devstack sudo[91458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:05 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5e66746f-f8db-4322-93c1-415329bb5971 Feb 26 20:37:05 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:05 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5e66746f-f8db-4322-93c1-415329bb5971" returned: 0 in 0.489s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5e66746f-f8db-4322-93c1-415329bb5971 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:05 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5e66746f-f8db-4322-93c1-415329bb5971 Feb 26 20:37:05 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:05 devstack sudo[91458]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8578d45a-7efd-41f1-bc2b-043485bb290b -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411" returned: 0 in 0.551s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:05 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 is being set with open permissions: ugo+rw Feb 26 20:37:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:05 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 Feb 26 20:37:05 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:05 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:05 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-5e66746f-f8db-4322-93c1-415329bb5971" returned: 0 in 0.458s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:05 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-5e66746f-f8db-4322-93c1-415329bb5971" released by "delete_volume" :: held 0.974s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:05 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created reservations ['1a4cb9a4-f6d8-4eff-a1f7-d5acfb203f52', '4ab93159-beeb-4f13-83b7-190da92fda83', '3d011f7a-d71b-467c-b875-23e691085003', '4cb0af72-834b-495f-aea9-77ab7ac1fb37'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:06 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411" returned: 0 in 0.507s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:06 devstack sudo[91473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:06 devstack sudo[91473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:06 devstack sudo[91475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.info Feb 26 20:37:06 devstack sudo[91475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:06 devstack sudo[91473]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.427s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:06 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Deleted volume successfully. Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c7178179-59b2-423b-b3b9-a435bf1925bd tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-5e66746f-f8db-4322-93c1-415329bb5971-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:06 devstack sudo[91475]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.info" returned: 0 in 0.506s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:06 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.info is being set with open permissions: ugo+rw Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:06 devstack sudo[91479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.info Feb 26 20:37:06 devstack sudo[91479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-quobyte-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[1998ea9f-7e1a-44ed-8b6c-e8604ef65f0f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:06 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:07 devstack sudo[91479]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.info" returned: 0 in 0.464s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.640s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:07 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df Feb 26 20:37:07 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.665s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1763684083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac022ee2-fa3f-48fd-81be-7cbad25f9a39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd6ed7b96f045a8929787e14605b5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:03Z,use_quota=True,user_id='45db87936747461a8a5eb9c134b3bc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Creating volume ac022ee2-fa3f-48fd-81be-7cbad25f9a39 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:37:07 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:07 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39 1073741824 Feb 26 20:37:07 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:07 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-5512e7a6-8fe4-40ab-8135-a94b17bb45e3 tempest-SnapshotDependencyTests-1556842265 None] Create snapshot completed successfully Feb 26 20:37:07 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df" returned: 0 in 0.520s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:07 devstack sudo[91490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df Feb 26 20:37:07 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:07 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39 1073741824" returned: 0 in 0.645s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:07 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:07 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39 Feb 26 20:37:07 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:08 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df" returned: 0 in 0.557s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df" released by "delete_volume" :: held 1.110s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Flow 'volume_create_manager' (d1e4bb59-9001-4b22-b8af-726b7817e7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01b9106-f9e6-46a2-9e5f-f22f778e998b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01b9106-f9e6-46a2-9e5f-f22f778e998b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18083e00-ac56-43ae-a843-18ed6355fa73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec98ec9e5db0493d83509bd4835d0600',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9f2e8637-754f-4daf-a608-b7d183820411,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:08Z,use_quota=True,user_id='c75cc628eb5f4331858f8110a10e2adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8654013f-c8f8-4a86-a59d-8002247cdb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8654013f-c8f8-4a86-a59d-8002247cdb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c6afc0-d3ff-4492-a1d9-9f86cd7ff826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72c6afc0-d3ff-4492-a1d9-9f86cd7ff826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '18083e00-ac56-43ae-a843-18ed6355fa73', 'volume_name': 'volume-18083e00-ac56-43ae-a843-18ed6355fa73', 'volume_size': 1, 'snapshot_id': '9f2e8637-754f-4daf-a608-b7d183820411'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59aa1dbb-85b1-4597-8ba8-f0fde9add424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59aa1dbb-85b1-4597-8ba8-f0fde9add424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a98b6eb-22d9-470a-aafc-2afb70301639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:08 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Volume 18083e00-ac56-43ae-a843-18ed6355fa73: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-18083e00-ac56-43ae-a843-18ed6355fa73', 'volume_size': 1, 'snapshot_id': '9f2e8637-754f-4daf-a608-b7d183820411'} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created reservations ['119f82fd-f0de-41d7-94f3-669ca7d2691b', '290b5328-ba66-4e2e-a8f3-5bf764dfa3d2', '90383074-6cc4-4969-ac25-a8dd01dababa', 'f921a9d9-386e-4826-92c1-a04d0b59ec5a'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:08 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:08 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:08 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39" returned: 0 in 0.562s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.605s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2049637353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8295da35-ff06-49ab-b6b1-66d7da669ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd6ed7b96f045a8929787e14605b5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:04Z,use_quota=True,user_id='45db87936747461a8a5eb9c134b3bc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Creating volume 8295da35-ff06-49ab-b6b1-66d7da669ab5 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:37:08 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8295da35-ff06-49ab-b6b1-66d7da669ab5 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f07cbc8-094d-443d-8bff-b2bcbe5fa7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897bb340-b5c6-45d8-8db2-171116e9c7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:08 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8295da35-ff06-49ab-b6b1-66d7da669ab5 1073741824 Feb 26 20:37:08 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:08 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39 (ac022ee2-fa3f-48fd-81be-7cbad25f9a39): created successfully Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (897bb340-b5c6-45d8-8db2-171116e9c7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Flow 'volume_create_manager' (92774a67-da0c-47ad-b191-a74225bd7543) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:08 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-59b61ed9-bd32-4bc1-b393-16ad2d716051 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Created volume successfully. Feb 26 20:37:08 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.458s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:08 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Deleted volume successfully. Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-3a1d178b-9e18-40c1-9a59-251aefab14be tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-d3cba9e3-4ed2-4cd3-911d-25c46cb1f2df-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:08 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8295da35-ff06-49ab-b6b1-66d7da669ab5 1073741824" returned: 0 in 0.527s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:08 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8295da35-ff06-49ab-b6b1-66d7da669ab5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:08 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8295da35-ff06-49ab-b6b1-66d7da669ab5 Feb 26 20:37:08 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-0812463c-6e0c-472a-ab5d-3324f1ad5b42-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-0812463c-6e0c-472a-ab5d-3324f1ad5b42-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-quobyte-0812463c-6e0c-472a-ab5d-3324f1ad5b42" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-0812463c-6e0c-472a-ab5d-3324f1ad5b42" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d007f069-1a24-4465-8e8c-04a34bda34b1]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:09 devstack sudo[91509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42 Feb 26 20:37:09 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:09 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8295da35-ff06-49ab-b6b1-66d7da669ab5" returned: 0 in 0.453s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.315s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1416492559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa3d5440-3559-46df-8d5f-e42b899c5219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd6ed7b96f045a8929787e14605b5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:04Z,use_quota=True,user_id='45db87936747461a8a5eb9c134b3bc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Creating volume aa3d5440-3559-46df-8d5f-e42b899c5219 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:37:09 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa3d5440-3559-46df-8d5f-e42b899c5219 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e75e30-4a71-4a97-bbc0-2ec50c441e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8295da35-ff06-49ab-b6b1-66d7da669ab5', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec04b8b-f5df-4301-8c85-0109badb607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:09 devstack sudo[91512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa3d5440-3559-46df-8d5f-e42b899c5219 1073741824 Feb 26 20:37:09 devstack sudo[91512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:09 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume volume-8295da35-ff06-49ab-b6b1-66d7da669ab5 (8295da35-ff06-49ab-b6b1-66d7da669ab5): created successfully Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec04b8b-f5df-4301-8c85-0109badb607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Flow 'volume_create_manager' (d120df6c-c874-42c3-abe1-49d4dbb38059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:09 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-e62ab351-0c43-4723-9a0c-958a9ba3cc8e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Created volume successfully. Feb 26 20:37:09 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42" returned: 0 in 0.483s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:09 devstack sudo[91518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42 Feb 26 20:37:09 devstack sudo[91518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:09 devstack sudo[91512]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa3d5440-3559-46df-8d5f-e42b899c5219 1073741824" returned: 0 in 0.585s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:09 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa3d5440-3559-46df-8d5f-e42b899c5219 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:10 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa3d5440-3559-46df-8d5f-e42b899c5219 Feb 26 20:37:10 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:10 devstack sudo[91518]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-0812463c-6e0c-472a-ab5d-3324f1ad5b42" returned: 0 in 0.431s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-0812463c-6e0c-472a-ab5d-3324f1ad5b42" released by "delete_volume" :: held 0.936s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created reservations ['fb465f6d-8d99-452c-9ff2-f8e40360ee96', '08a36de9-3ddf-496b-afef-8d50f6f96102', '583d3e5b-7dd7-4a27-bd18-a5782a6b85eb', '29cf5311-28c6-4b12-9746-1affcfa51da0'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:10 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:10 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-e1781924-961c-409c-8737-c6d0143f39d9-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-e1781924-961c-409c-8737-c6d0143f39d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-quobyte-923e8120-ab2a-4654-a7ec-8b06e84d8688" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-923e8120-ab2a-4654-a7ec-8b06e84d8688" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-quobyte-e1781924-961c-409c-8737-c6d0143f39d9" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-e1781924-961c-409c-8737-c6d0143f39d9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Deleting offline snapshot e1781924-961c-409c-8737-c6d0143f39d9 of volume 923e8120-ab2a-4654-a7ec-8b06e84d8688 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] snapshot_file for this snap is: volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[1269d305-964d-4263-a93d-a084954d86eb]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:10 devstack sudo[91528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 Feb 26 20:37:10 devstack sudo[91528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:10 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa3d5440-3559-46df-8d5f-e42b899c5219" returned: 0 in 0.462s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.018s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1301239585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93524fa-39a0-4bbd-9a1e-957e8327114d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd6ed7b96f045a8929787e14605b5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:04Z,use_quota=True,user_id='45db87936747461a8a5eb9c134b3bc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Creating volume d93524fa-39a0-4bbd-9a1e-957e8327114d {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:37:10 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d93524fa-39a0-4bbd-9a1e-957e8327114d 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a865014-8a8c-472c-a221-e9f749b0d4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3d5440-3559-46df-8d5f-e42b899c5219', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:10 devstack sudo[91531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d93524fa-39a0-4bbd-9a1e-957e8327114d 1073741824 Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f42ca9-a60b-4012-91b7-595fededaa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:10 devstack sudo[91531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:10 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume volume-aa3d5440-3559-46df-8d5f-e42b899c5219 (aa3d5440-3559-46df-8d5f-e42b899c5219): created successfully Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f42ca9-a60b-4012-91b7-595fededaa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Flow 'volume_create_manager' (fc0b9ee2-2a4f-4d64-9d6e-480ea6b43e7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:10 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a3df983d-3317-452b-b761-c319158b2f53 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Created volume successfully. Feb 26 20:37:10 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.535s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:10 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Deleted volume successfully. Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-caf2d7f4-7e70-4a38-a1be-54e81b59f7a0 tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-0812463c-6e0c-472a-ab5d-3324f1ad5b42-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:10 devstack sudo[91528]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9" returned: 0 in 0.479s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-923e8120-ab2a-4654-a7ec-8b06e84d8688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c4a061-2259-4c9d-be4d-29ab0de98bbf]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:10 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:10 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 Feb 26 20:37:10 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:11 devstack sudo[91531]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d93524fa-39a0-4bbd-9a1e-957e8327114d 1073741824" returned: 0 in 0.590s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d93524fa-39a0-4bbd-9a1e-957e8327114d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:11 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d93524fa-39a0-4bbd-9a1e-957e8327114d Feb 26 20:37:11 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:11 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688" returned: 0 in 0.491s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:11 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 Feb 26 20:37:11 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:11 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d93524fa-39a0-4bbd-9a1e-957e8327114d" returned: 0 in 0.401s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.660s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1141330605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abee5c7-0f3b-44a8-83a3-8dbe9db71f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd6ed7b96f045a8929787e14605b5b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:05Z,use_quota=True,user_id='45db87936747461a8a5eb9c134b3bc82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Creating volume 8abee5c7-0f3b-44a8-83a3-8dbe9db71f66 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:37:11 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1605d299-7336-4b22-8505-daaeaa173131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d93524fa-39a0-4bbd-9a1e-957e8327114d', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f85db39-cc7e-41bf-a977-c530b9a7239b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:11 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66 1073741824 Feb 26 20:37:11 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:11 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume volume-d93524fa-39a0-4bbd-9a1e-957e8327114d (d93524fa-39a0-4bbd-9a1e-957e8327114d): created successfully Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f85db39-cc7e-41bf-a977-c530b9a7239b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Flow 'volume_create_manager' (388b02c2-33d8-4cac-85a3-8aa2d95e29d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:11 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-43902cae-8a68-462a-8d31-d145f95374d3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Created volume successfully. Feb 26 20:37:11 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9" returned: 0 in 0.506s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:11 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:11 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9 Feb 26 20:37:11 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:12 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66 1073741824" returned: 0 in 0.632s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:12 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66 Feb 26 20:37:12 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:12 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688.e1781924-961c-409c-8737-c6d0143f39d9" returned: 0 in 0.476s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-e1781924-961c-409c-8737-c6d0143f39d9" released by "_delete_snapshot" :: held 2.014s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-923e8120-ab2a-4654-a7ec-8b06e84d8688" released by "delete_snapshot" :: held 2.026s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created reservations ['aef2d6e6-37c4-4423-9aab-9a9050345dff', '66741732-8ed7-4279-8913-f99339645d5d', '32e2cfd6-1c54-4265-a52b-c2d36e7bf510', 'ef17f39a-da17-426e-8cf1-6f8ea84422a7'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:12 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Delete snapshot completed successfully. Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c52f5406-5976-49e3-992a-dea842b3be4f tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-e1781924-961c-409c-8737-c6d0143f39d9-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:12 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66" returned: 0 in 0.424s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.656s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:12 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Cloning volume 3344b5a6-5055-4817-bba5-314b8cb8ad13 to volume 7d12fcd9-b6b5-4894-8487-2917256c2752 Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902cc447-5b1e-468e-8079-ba10ffd746cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7fd71a-b3b9-4fb5-b8dc-92c14a18c094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:12 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Volume volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66 (8abee5c7-0f3b-44a8-83a3-8dbe9db71f66): created successfully Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7fd71a-b3b9-4fb5-b8dc-92c14a18c094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Flow 'volume_create_manager' (f7da619c-94cf-4487-95b1-91450f3a216a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Creating offline snapshot 12461ead-c8ab-4f58-b3db-f4b981c8b1db of volume 3344b5a6-5055-4817-bba5-314b8cb8ad13 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:37:12 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-83a665cd-2851-4bb4-aa6e-9e6d193de73e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Created volume successfully. Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d81c7b4-053f-4cb9-8c2c-f0a8d7521b91]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:12 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:12 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 Feb 26 20:37:12 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:13 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13" returned: 0 in 0.442s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:13 devstack sudo[91569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db 1G Feb 26 20:37:13 devstack sudo[91569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "cinder-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "cinder-quobyte-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-quobyte-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2b0cf6-ece6-4f73-9806-98bbcc75317f]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:13 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66 Feb 26 20:37:13 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-923e8120-ab2a-4654-a7ec-8b06e84d8688-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-923e8120-ab2a-4654-a7ec-8b06e84d8688-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "cinder-quobyte-923e8120-ab2a-4654-a7ec-8b06e84d8688" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-923e8120-ab2a-4654-a7ec-8b06e84d8688" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[36beab65-2f4c-453d-b3db-77b9dc9b8f82]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:13 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 Feb 26 20:37:13 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:13 devstack sudo[91569]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db 1G" returned: 0 in 0.510s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:13 devstack sudo[91578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db Feb 26 20:37:13 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:13 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66" returned: 0 in 0.512s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:13 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:13 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66 Feb 26 20:37:13 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:14 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688" returned: 0 in 0.564s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:14 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db" returned: 0 in 0.455s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:14 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db is being set with open permissions: ugo+rw Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:14 devstack sudo[91591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688 Feb 26 20:37:14 devstack sudo[91591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:14 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db Feb 26 20:37:14 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:14 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66" returned: 0 in 0.417s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-quobyte-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66" released by "delete_volume" :: held 0.962s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Created reservations ['731bdfd6-e705-4fbd-9ea2-0d231f4251a9', 'b1052b04-b382-42db-88a8-ab094e0a2745', 'c8963903-4c7f-44a7-9343-b3b902cd894e', '5e4cabe3-741e-4b70-8669-81092acd8579'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:14 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:14 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "cinder-d93524fa-39a0-4bbd-9a1e-957e8327114d-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-d93524fa-39a0-4bbd-9a1e-957e8327114d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "cinder-quobyte-d93524fa-39a0-4bbd-9a1e-957e8327114d" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-quobyte-d93524fa-39a0-4bbd-9a1e-957e8327114d" acquired by "delete_volume" :: waited 0.024s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:14 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db" returned: 0 in 0.460s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f3a200-8132-4694-8935-c1ea1c0f5b9c]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d93524fa-39a0-4bbd-9a1e-957e8327114d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:14 devstack sudo[91591]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-923e8120-ab2a-4654-a7ec-8b06e84d8688" returned: 0 in 0.532s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:14 devstack sudo[91601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.info Feb 26 20:37:14 devstack sudo[91601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-quobyte-923e8120-ab2a-4654-a7ec-8b06e84d8688" released by "delete_volume" :: held 1.131s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:14 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d93524fa-39a0-4bbd-9a1e-957e8327114d Feb 26 20:37:14 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Created reservations ['6f7d9788-d24b-4df7-8f30-7dc06255a5b6', '8ed894ba-8bbc-40ef-85a6-f3dcc7b7298d', 'daf83169-982e-42eb-8bdf-3c4a2d552d99', '6a26958f-8479-4da2-b0fe-50602eaae41c'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:14 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:14 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:14 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.539s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:14 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Deleted volume successfully. Feb 26 20:37:14 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-a2210f66-176f-4e10-a8c2-99fe5f69af0e tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-8abee5c7-0f3b-44a8-83a3-8dbe9db71f66-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:15 devstack sudo[91601]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.info" returned: 0 in 0.479s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:15 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.info is being set with open permissions: ugo+rw Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:15 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.info Feb 26 20:37:15 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:15 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d93524fa-39a0-4bbd-9a1e-957e8327114d" returned: 0 in 0.577s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d93524fa-39a0-4bbd-9a1e-957e8327114d {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:15 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d93524fa-39a0-4bbd-9a1e-957e8327114d Feb 26 20:37:15 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:15 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.482s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:15 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Deleted volume successfully. Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d1275492-9d0b-4600-be82-96c438b427ff tempest-CreateVolumesFromSnapshotTest-1155235923 None] Lock "cinder-923e8120-ab2a-4654-a7ec-8b06e84d8688-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:15 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.info" returned: 0 in 0.447s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-quobyte-7d12fcd9-b6b5-4894-8487-2917256c2752" by "_copy_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-7d12fcd9-b6b5-4894-8487-2917256c2752" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] snapshot: 12461ead-c8ab-4f58-b3db-f4b981c8b1db, volume: 7d12fcd9-b6b5-4894-8487-2917256c2752, {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd1fcd7-ff00-4d7d-ba17-55a58be23a3e]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:15 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-d93524fa-39a0-4bbd-9a1e-957e8327114d" returned: 0 in 0.518s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:15 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db Feb 26 20:37:15 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-quobyte-d93524fa-39a0-4bbd-9a1e-957e8327114d" released by "delete_volume" :: held 1.127s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Created reservations ['2e3a5286-a92e-440e-8975-cd38b20acaba', '44e75c60-f25f-43e1-9dfd-9f9c7eaf5d51', '625bf3cf-e809-4b54-bae2-c2ccdf98d672', '14b8a6ee-f6ab-4521-b0cc-3628fa9b30d9'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:15 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:15 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:15 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:16 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db" returned: 0 in 0.572s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3344b5a6-5055-4817-bba5-314b8cb8ad13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Creating direct copy from snapshot {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc388aa-1c65-4d36-9055-b4c55b4c3b21]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:16 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.474s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:16 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Deleted volume successfully. Feb 26 20:37:16 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 Feb 26 20:37:16 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-ec1ffe66-8004-4edb-903e-66b7dd0ffb6f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-d93524fa-39a0-4bbd-9a1e-957e8327114d-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "cinder-aa3d5440-3559-46df-8d5f-e42b899c5219-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-aa3d5440-3559-46df-8d5f-e42b899c5219-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "cinder-quobyte-aa3d5440-3559-46df-8d5f-e42b899c5219" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-quobyte-aa3d5440-3559-46df-8d5f-e42b899c5219" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:16 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13" returned: 0 in 0.622s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG cinder.utils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Path /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752 not found in is_blk_device check {{(pid=83352) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aee71dc-0ca1-46b8-a463-5889541e7750]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:16 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa3d5440-3559-46df-8d5f-e42b899c5219 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:16 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752 Feb 26 20:37:16 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:16 devstack sudo[91632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa3d5440-3559-46df-8d5f-e42b899c5219 Feb 26 20:37:16 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:17 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa3d5440-3559-46df-8d5f-e42b899c5219" returned: 0 in 0.688s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:17 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa3d5440-3559-46df-8d5f-e42b899c5219 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:17 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa3d5440-3559-46df-8d5f-e42b899c5219 Feb 26 20:37:17 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:18 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-aa3d5440-3559-46df-8d5f-e42b899c5219" returned: 0 in 1.204s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-quobyte-aa3d5440-3559-46df-8d5f-e42b899c5219" released by "delete_volume" :: held 1.946s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Created reservations ['afa00aa4-381f-4f81-84e9-54320f036b5b', 'b52de1ed-2c4a-4435-8e71-7b1c834fe32b', 'bc77e18a-a86a-4d14-835d-7fc600ae5148', '8c8ecab3-4a50-4ac6-876c-c1ec2fb50ddb'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:18 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752" returned: 0 in 2.086s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad5a6b0-5d4d-4f24-90df-77070fa36e62]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:18 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:18 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "cinder-8295da35-ff06-49ab-b6b1-66d7da669ab5-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-8295da35-ff06-49ab-b6b1-66d7da669ab5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:18 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 Feb 26 20:37:18 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "cinder-quobyte-8295da35-ff06-49ab-b6b1-66d7da669ab5" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-quobyte-8295da35-ff06-49ab-b6b1-66d7da669ab5" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71387a8-7481-4d01-a007-8853c0bfe484]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:18 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8295da35-ff06-49ab-b6b1-66d7da669ab5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:19 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8295da35-ff06-49ab-b6b1-66d7da669ab5 Feb 26 20:37:19 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:19 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.446s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:19 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Deleted volume successfully. Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-08878341-c8ff-4753-82d7-0d8d88914ded tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-aa3d5440-3559-46df-8d5f-e42b899c5219-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:19 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8295da35-ff06-49ab-b6b1-66d7da669ab5" returned: 0 in 0.502s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8295da35-ff06-49ab-b6b1-66d7da669ab5 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:19 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13" returned: 0 in 0.638s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752 {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:37:19 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Converted 1024.00 MB image at 490.21 MB/s Feb 26 20:37:19 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752 is being set with open permissions: ugo+rw Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:19 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8295da35-ff06-49ab-b6b1-66d7da669ab5 Feb 26 20:37:19 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:19 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752 Feb 26 20:37:19 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:19 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8295da35-ff06-49ab-b6b1-66d7da669ab5" returned: 0 in 0.424s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:19 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752" returned: 0 in 0.419s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-quobyte-8295da35-ff06-49ab-b6b1-66d7da669ab5" released by "delete_volume" :: held 0.953s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-7d12fcd9-b6b5-4894-8487-2917256c2752" released by "_copy_volume_from_snapshot" :: held 4.412s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-quobyte-12461ead-c8ab-4f58-b3db-f4b981c8b1db" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-12461ead-c8ab-4f58-b3db-f4b981c8b1db" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Deleting offline snapshot 12461ead-c8ab-4f58-b3db-f4b981c8b1db of volume 3344b5a6-5055-4817-bba5-314b8cb8ad13 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] snapshot_file for this snap is: volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abb9518-af95-4611-a026-d477e83afbdf]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:19 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Created reservations ['889a81bf-0e01-4a35-844f-0247c65b9608', '117d42df-87e9-4b90-8c92-07f88167fbb9', '4044158a-6afd-4b37-b3de-d88e21614c4d', '14cd6e72-90e6-4aed-b74e-e1d0bcbe0b12'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:20 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db Feb 26 20:37:20 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:20 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:20 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:20 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.417s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:20 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Deleted volume successfully. Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6fa95599-c7e0-464f-95d1-33ffe78fbeb3 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-8295da35-ff06-49ab-b6b1-66d7da669ab5-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:20 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db" returned: 0 in 0.531s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3344b5a6-5055-4817-bba5-314b8cb8ad13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9b01d5-afca-48db-9d9c-ba0fc008c8e1]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:20 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 Feb 26 20:37:20 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:20 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13" returned: 0 in 0.479s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:20 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:21 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db Feb 26 20:37:21 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "cinder-ac022ee2-fa3f-48fd-81be-7cbad25f9a39-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-ac022ee2-fa3f-48fd-81be-7cbad25f9a39-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "cinder-quobyte-ac022ee2-fa3f-48fd-81be-7cbad25f9a39" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-quobyte-ac022ee2-fa3f-48fd-81be-7cbad25f9a39" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63fe167-5a50-43e3-890d-ee042cef8f49]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:21 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39 Feb 26 20:37:21 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:21 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db" returned: 0 in 0.534s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:21 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db Feb 26 20:37:21 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:21 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39" returned: 0 in 0.507s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:21 devstack sudo[91696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39 Feb 26 20:37:21 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:21 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13.12461ead-c8ab-4f58-b3db-f4b981c8b1db" returned: 0 in 0.430s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-12461ead-c8ab-4f58-b3db-f4b981c8b1db" released by "_delete_snapshot" :: held 2.035s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.406s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 13.772s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:21 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "cinder-quobyte-9f2e8637-754f-4daf-a608-b7d183820411-18083e00-ac56-43ae-a843-18ed6355fa73" by "_create_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c3a7ac4-72a4-43ab-af35-d1e01412a82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d12fcd9-b6b5-4894-8487-2917256c2752', 'volume_size': 1, 'source_volid': '3344b5a6-5055-4817-bba5-314b8cb8ad13', 'source_volstatus': 'available'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c522ad7d-d841-4c2d-b104-c34278652ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-quobyte-9f2e8637-754f-4daf-a608-b7d183820411-18083e00-ac56-43ae-a843-18ed6355fa73" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Creating volume 18083e00-ac56-43ae-a843-18ed6355fa73 from snapshot 9f2e8637-754f-4daf-a608-b7d183820411 {{(pid=83352) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "cinder-quobyte-18083e00-ac56-43ae-a843-18ed6355fa73" by "_copy_volume_from_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:22 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Volume volume-7d12fcd9-b6b5-4894-8487-2917256c2752 (7d12fcd9-b6b5-4894-8487-2917256c2752): created successfully Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c522ad7d-d841-4c2d-b104-c34278652ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Flow 'volume_create_manager' (8c941cc1-bc9a-4a56-9bc8-f03b79742298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-quobyte-18083e00-ac56-43ae-a843-18ed6355fa73" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] snapshot: 9f2e8637-754f-4daf-a608-b7d183820411, volume: 18083e00-ac56-43ae-a843-18ed6355fa73, {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Feb 26 20:37:22 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-7b47e5a0-2fc1-492f-9e25-d449f8f4b5d8 tempest-VolumeDependencyTests-560135568 None] Created volume successfully. Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c6de6c-aa7c-403a-8de2-930f6aa91e66]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:22 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-ac022ee2-fa3f-48fd-81be-7cbad25f9a39" returned: 0 in 0.445s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-quobyte-ac022ee2-fa3f-48fd-81be-7cbad25f9a39" released by "delete_volume" :: held 0.980s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:22 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 Feb 26 20:37:22 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Created reservations ['b2a58233-92af-4228-b7dc-15fd252a5c9c', '45eef299-edd6-4349-9741-8d3adb1d6a43', 'c39984ea-6f13-4816-ac54-2ed58578f2ba', 'a8957076-6ae9-407b-be77-8cf30f1c92b0'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:22 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:22 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-3344b5a6-5055-4817-bba5-314b8cb8ad13-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-3344b5a6-5055-4817-bba5-314b8cb8ad13-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-quobyte-3344b5a6-5055-4817-bba5-314b8cb8ad13" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-3344b5a6-5055-4817-bba5-314b8cb8ad13" acquired by "delete_volume" :: waited 0.019s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:22 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411" returned: 0 in 0.582s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8578d45a-7efd-41f1-bc2b-043485bb290b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] will copy from snapshot at /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Creating direct copy from snapshot {{(pid=83352) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[608bd810-5fba-4bdc-8721-596e6f61e52b]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd037208-5b75-4776-b507-63bc3433a06a]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:22 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.442s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:22 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Deleted volume successfully. Feb 26 20:37:22 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 Feb 26 20:37:22 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:22 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b Feb 26 20:37:22 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:22 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-d84597fb-aa51-4e29-bb02-3c188cb7636f tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-ac022ee2-fa3f-48fd-81be-7cbad25f9a39-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:23 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13" returned: 0 in 0.502s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:23 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13 Feb 26 20:37:23 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:23 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b" returned: 0 in 0.550s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG cinder.utils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Path /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73 not found in is_blk_device check {{(pid=83352) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:23 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73 Feb 26 20:37:23 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "cinder-194f56db-d83a-4f60-bf4a-cd9ce2665f75-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-194f56db-d83a-4f60-bf4a-cd9ce2665f75-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "cinder-quobyte-194f56db-d83a-4f60-bf4a-cd9ce2665f75" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-quobyte-194f56db-d83a-4f60-bf4a-cd9ce2665f75" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[4053e04c-f877-465a-953b-592bd400253e]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:23 devstack sudo[91722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75 Feb 26 20:37:23 devstack sudo[91722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:23 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-3344b5a6-5055-4817-bba5-314b8cb8ad13" returned: 0 in 0.446s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-3344b5a6-5055-4817-bba5-314b8cb8ad13" released by "delete_volume" :: held 0.984s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Created reservations ['9793964c-ea86-446c-a2f2-ccadfe594de7', 'b41a4a2a-c549-47d3-a6ec-8e843475982b', '609c9cc4-b0df-4d28-88c5-0f73f681bdc4', '9dcb238e-e380-4060-a5bf-da4266285a75'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:23 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:23 devstack sudo[91738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:23 devstack sudo[91738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:24 devstack sudo[91722]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75" returned: 0 in 0.711s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:24 devstack sudo[91740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75 Feb 26 20:37:24 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:24 devstack cinder-volume[83352]: DEBUG oslo_service.periodic_task [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83352) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Feb 26 20:37:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:24 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:24 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:24 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:24 devstack sudo[91738]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:24 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.827s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:24 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:24 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Deleted volume successfully. Feb 26 20:37:24 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-52b476fd-14e2-4824-bc15-350544b89773 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-3344b5a6-5055-4817-bba5-314b8cb8ad13-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-7d12fcd9-b6b5-4894-8487-2917256c2752-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-7d12fcd9-b6b5-4894-8487-2917256c2752-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-quobyte-7d12fcd9-b6b5-4894-8487-2917256c2752" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-7d12fcd9-b6b5-4894-8487-2917256c2752" acquired by "delete_volume" :: waited 0.027s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bd4347-0b99-4431-bdff-6595cb83d8e5]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:25 devstack sudo[91746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752 Feb 26 20:37:25 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:25 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-194f56db-d83a-4f60-bf4a-cd9ce2665f75" returned: 0 in 1.636s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-quobyte-194f56db-d83a-4f60-bf4a-cd9ce2665f75" released by "delete_volume" :: held 2.370s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Created reservations ['f4a7d779-ecbc-4fb2-aefc-e07578fd6dd7', '19de189a-3b7b-4e3c-be83-35fc9d7e83d5', '4fe1ed8d-83f9-4df7-a5de-ef15d00aaa37', '49ae2cae-f59d-4889-a6a7-87f3b8cadc74'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:25 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73" returned: 0 in 2.532s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d119a8-8c35-42e5-837f-15b1c59df855]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:25 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:25 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:25 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 1.663s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:25 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9b1413a0-a1e9-48d1-8144-6e5924fbb8d0 None None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:25 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b Feb 26 20:37:25 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:26 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752" returned: 0 in 0.761s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:26 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752 Feb 26 20:37:26 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:26 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.446s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:26 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Deleted volume successfully. Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8fdab63f-c414-47a2-96f9-ab439b051861 tempest-CreateVolumesFromSourceVolumeTest-1386283264 None] Lock "cinder-194f56db-d83a-4f60-bf4a-cd9ce2665f75-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:26 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b" returned: 0 in 0.714s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG cinder.image.image_utils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Image conversion details: src /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73 {{(pid=83352) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Feb 26 20:37:26 devstack cinder-volume[83352]: INFO cinder.image.image_utils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Converted 1024.00 MB image at 404.12 MB/s Feb 26 20:37:26 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73 is being set with open permissions: ugo+rw Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:26 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-7d12fcd9-b6b5-4894-8487-2917256c2752" returned: 0 in 0.468s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:26 devstack sudo[91763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73 Feb 26 20:37:26 devstack sudo[91763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-7d12fcd9-b6b5-4894-8487-2917256c2752" released by "delete_volume" :: held 1.271s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Created reservations ['15e760b0-0054-4a25-b33d-e7ce0a3d8225', '0c36f545-0d81-4572-8492-2e3bde217b03', '21f2e4c2-9a90-4dd5-81ca-50416c3aa4ca', 'd5c3e503-cc0c-4d4a-927f-847eacf69ee5'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:26 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:26 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:26 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:27 devstack sudo[91763]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73" returned: 0 in 0.504s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-quobyte-18083e00-ac56-43ae-a843-18ed6355fa73" released by "_copy_volume_from_snapshot" :: held 4.984s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-quobyte-9f2e8637-754f-4daf-a608-b7d183820411-18083e00-ac56-43ae-a843-18ed6355fa73" released by "_create_volume_from_snapshot" :: held 5.017s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.040s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a98b6eb-22d9-470a-aafc-2afb70301639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18083e00-ac56-43ae-a843-18ed6355fa73', 'volume_size': 1, 'snapshot_id': '9f2e8637-754f-4daf-a608-b7d183820411'}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d077d7-3bcb-4237-af2b-6e25d4c922c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:27 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Volume volume-18083e00-ac56-43ae-a843-18ed6355fa73 (18083e00-ac56-43ae-a843-18ed6355fa73): created successfully Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d077d7-3bcb-4237-af2b-6e25d4c922c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Flow 'volume_create_manager' (d1e4bb59-9001-4b22-b8af-726b7817e7bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:27 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-8a62fcdc-b254-488d-8bc3-b030c9bb79c6 tempest-SnapshotDependencyTests-1556842265 None] Created volume successfully. Feb 26 20:37:27 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.476s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:27 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Deleted volume successfully. Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-eb99384d-e97a-4e47-bbe1-22287d31b1f9 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-7d12fcd9-b6b5-4894-8487-2917256c2752-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-41c17b86-bd7d-489e-b8b9-0a7167edc71f-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-41c17b86-bd7d-489e-b8b9-0a7167edc71f-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "cinder-quobyte-41c17b86-bd7d-489e-b8b9-0a7167edc71f" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-41c17b86-bd7d-489e-b8b9-0a7167edc71f" acquired by "delete_volume" :: waited 0.018s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[3524daad-372a-4a66-8b61-30569f16f553]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:27 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f Feb 26 20:37:27 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "cinder-9f2e8637-754f-4daf-a608-b7d183820411-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-9f2e8637-754f-4daf-a608-b7d183820411-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "cinder-quobyte-8578d45a-7efd-41f1-bc2b-043485bb290b" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-quobyte-8578d45a-7efd-41f1-bc2b-043485bb290b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "cinder-quobyte-9f2e8637-754f-4daf-a608-b7d183820411" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-quobyte-9f2e8637-754f-4daf-a608-b7d183820411" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Deleting offline snapshot 9f2e8637-754f-4daf-a608-b7d183820411 of volume 8578d45a-7efd-41f1-bc2b-043485bb290b {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] snapshot_file for this snap is: volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[d968d9d4-8ec4-4579-b511-2933b3aae15d]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:27 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:27 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 Feb 26 20:37:27 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:28 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f" returned: 0 in 0.604s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:28 devstack sudo[91776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f Feb 26 20:37:28 devstack sudo[91776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:28 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411" returned: 0 in 0.599s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8578d45a-7efd-41f1-bc2b-043485bb290b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cce060-350b-4d61-9efa-0698642843e4]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:28 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b Feb 26 20:37:28 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:28 devstack sudo[91776]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-41c17b86-bd7d-489e-b8b9-0a7167edc71f" returned: 0 in 0.522s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-quobyte-41c17b86-bd7d-489e-b8b9-0a7167edc71f" released by "delete_volume" :: held 1.152s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Created reservations ['4ae7a948-1de0-4e49-b598-dced12288c0a', '916d76c0-3898-4151-9f6d-e05f34ca01e7', 'b7242315-cf57-4a83-97e4-b66fe08941c1', 'a6e3f977-ca6b-40d9-ac8a-2cf8067f7318'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:28 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:28 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Flow 'volume_create_manager' (597996de-e118-4361-af95-9d2cb666a004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c15e333-cebf-437a-b1d1-7934d95986f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c15e333-cebf-437a-b1d1-7934d95986f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fac0d90-b45b-404e-b59c-988a9d98e428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609238fd850a415699041e5b920a5be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:29Z,use_quota=True,user_id='57a4705093fd46f19ae79b2dd41dd221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8bfd87-2c7a-4b80-9500-7550df4a7db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da8bfd87-2c7a-4b80-9500-7550df4a7db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9da4da-0ba9-43cb-bf9b-0fc4f9181c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9da4da-0ba9-43cb-bf9b-0fc4f9181c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fac0d90-b45b-404e-b59c-988a9d98e428', 'volume_name': 'volume-8fac0d90-b45b-404e-b59c-988a9d98e428', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85f5b81-7fe1-44e5-be9e-be938576bfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b85f5b81-7fe1-44e5-be9e-be938576bfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c09bfd-1d3d-4251-9c8c-a5a336d29e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:28 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Volume 8fac0d90-b45b-404e-b59c-988a9d98e428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fac0d90-b45b-404e-b59c-988a9d98e428', 'volume_size': 1} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fac0d90-b45b-404e-b59c-988a9d98e428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609238fd850a415699041e5b920a5be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:29Z,use_quota=True,user_id='57a4705093fd46f19ae79b2dd41dd221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Creating volume 8fac0d90-b45b-404e-b59c-988a9d98e428 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:37:28 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8fac0d90-b45b-404e-b59c-988a9d98e428 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:28 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8fac0d90-b45b-404e-b59c-988a9d98e428 1073741824 Feb 26 20:37:28 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:28 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b" returned: 0 in 0.584s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:28 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:28 devstack sudo[91791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 Feb 26 20:37:28 devstack sudo[91791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:29 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.453s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:29 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Deleted volume successfully. Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-25786472-ac8f-474c-890f-1cb9470128b1 tempest-VolumeDependencyTests-560135568 None] Lock "cinder-41c17b86-bd7d-489e-b8b9-0a7167edc71f-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:29 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8fac0d90-b45b-404e-b59c-988a9d98e428 1073741824" returned: 0 in 0.522s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8fac0d90-b45b-404e-b59c-988a9d98e428 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:29 devstack sudo[91791]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411" returned: 0 in 0.512s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:29 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8fac0d90-b45b-404e-b59c-988a9d98e428 Feb 26 20:37:29 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:29 devstack sudo[91802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411 Feb 26 20:37:29 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:29 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8fac0d90-b45b-404e-b59c-988a9d98e428" returned: 0 in 0.499s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c09bfd-1d3d-4251-9c8c-a5a336d29e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fac0d90-b45b-404e-b59c-988a9d98e428', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980d2bd5-d340-4956-9851-1eae9ced5acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:29 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Volume volume-8fac0d90-b45b-404e-b59c-988a9d98e428 (8fac0d90-b45b-404e-b59c-988a9d98e428): created successfully Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980d2bd5-d340-4956-9851-1eae9ced5acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:29 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Flow 'volume_create_manager' (597996de-e118-4361-af95-9d2cb666a004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:30 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-64b3bc44-d05b-4421-8a3d-983797e3ff64 tempest-CinderUnicodeTest-181173779 None] Created volume successfully. Feb 26 20:37:30 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b.9f2e8637-754f-4daf-a608-b7d183820411" returned: 0 in 0.537s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-quobyte-9f2e8637-754f-4daf-a608-b7d183820411" released by "_delete_snapshot" :: held 2.293s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-quobyte-8578d45a-7efd-41f1-bc2b-043485bb290b" released by "delete_snapshot" :: held 2.304s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:30 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Created reservations ['0f02d4d7-a47c-474a-855d-a4f5047c769f', '82e1fc97-6395-4090-85f8-290ec56df846', '2efd5eb2-dfae-4b4b-8843-d510c8ad645c', '5a8bcdc3-b778-48cc-858a-d2001f62fb40'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:30 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Delete snapshot completed successfully. Feb 26 20:37:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-6b7e8acd-f4de-43a7-903c-006ef04d2067 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-9f2e8637-754f-4daf-a608-b7d183820411-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "cinder-8578d45a-7efd-41f1-bc2b-043485bb290b-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-8578d45a-7efd-41f1-bc2b-043485bb290b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "cinder-quobyte-8578d45a-7efd-41f1-bc2b-043485bb290b" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:30 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-quobyte-8578d45a-7efd-41f1-bc2b-043485bb290b" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:30 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[504e3920-d4e0-4dbe-8f78-96e001998f62]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:30 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:31 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b Feb 26 20:37:31 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83352) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Flow 'volume_create_manager' (4e775a05-6681-411a-a033-b2098204655c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850dcc5c-6d5e-430a-b0db-179fbd660419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850dcc5c-6d5e-430a-b0db-179fbd660419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-992045870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0907f88-a77d-443e-8242-53546049ee82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609238fd850a415699041e5b920a5be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:31Z,use_quota=True,user_id='57a4705093fd46f19ae79b2dd41dd221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3517a419-c23f-43e0-9790-023e344f7dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3517a419-c23f-43e0-9790-023e344f7dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f97ebae-ef1e-4f40-92ce-572d8dbf4dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f97ebae-ef1e-4f40-92ce-572d8dbf4dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0907f88-a77d-443e-8242-53546049ee82', 'volume_name': 'volume-e0907f88-a77d-443e-8242-53546049ee82', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b6739f-1784-41de-aa3e-d82a08b76c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b6739f-1784-41de-aa3e-d82a08b76c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac61940-9544-4d18-bad6-d9be0ead5d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:31 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Volume e0907f88-a77d-443e-8242-53546049ee82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0907f88-a77d-443e-8242-53546049ee82', 'volume_size': 1} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-02-26T19:37:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-992045870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0907f88-a77d-443e-8242-53546049ee82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609238fd850a415699041e5b920a5be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-02-26T19:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-02-26T19:37:31Z,use_quota=True,user_id='57a4705093fd46f19ae79b2dd41dd221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0fc88f3-f09f-4521-b4c0-1b6505bc6656),volume_type_id=b0fc88f3-f09f-4521-b4c0-1b6505bc6656)}" {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Creating volume e0907f88-a77d-443e-8242-53546049ee82 {{(pid=83352) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Selected osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 as target Quobyte volume. {{(pid=83352) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Feb 26 20:37:31 devstack cinder-volume[83352]: INFO cinder.volume.drivers.remotefs [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] casted to osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316 Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 1073741824 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:31 devstack sudo[91810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 1073741824 Feb 26 20:37:31 devstack sudo[91810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:31 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b" returned: 0 in 0.547s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:31 devstack sudo[91815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b Feb 26 20:37:31 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:31 devstack sudo[91810]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 1073741824" returned: 0 in 0.514s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:31 devstack sudo[91820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 Feb 26 20:37:31 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:31 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8578d45a-7efd-41f1-bc2b-043485bb290b" returned: 0 in 0.454s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:31 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-quobyte-8578d45a-7efd-41f1-bc2b-043485bb290b" released by "delete_volume" :: held 1.044s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Created reservations ['8cb0d483-c5ed-48e1-95bf-dfec82a663b6', 'c2688fdd-3eb6-4cb3-a938-9bc5a1b1aecd', '705b16ed-2d0c-4350-8546-a55e670e0dc2', '5e495e2c-fb65-4bf2-bd65-f41fe0e710ac'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:32 devstack sudo[91823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:32 devstack sudo[91823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:32 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82" returned: 0 in 0.432s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'} {{(pid=83352) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ac61940-9544-4d18-bad6-d9be0ead5d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0907f88-a77d-443e-8242-53546049ee82', 'volume_size': 1}' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75daa26a-a0f0-403d-adb4-428b017dbf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Feb 26 20:37:32 devstack cinder-volume[83352]: INFO cinder.volume.flows.manager.create_volume [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Volume volume-e0907f88-a77d-443e-8242-53546049ee82 (e0907f88-a77d-443e-8242-53546049ee82): created successfully Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75daa26a-a0f0-403d-adb4-428b017dbf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83352) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Flow 'volume_create_manager' (4e775a05-6681-411a-a033-b2098204655c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83352) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Feb 26 20:37:32 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-1c1136f2-5509-4485-b457-f43d4db9db70 tempest-CinderUnicodeTest-181173779 None] Created volume successfully. Feb 26 20:37:32 devstack sudo[91823]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.415s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:32 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Deleted volume successfully. Feb 26 20:37:32 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-9609e444-1561-46bd-9903-03ec1eb453f6 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-8578d45a-7efd-41f1-bc2b-043485bb290b-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "cinder-18083e00-ac56-43ae-a843-18ed6355fa73-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-18083e00-ac56-43ae-a843-18ed6355fa73-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "cinder-quobyte-18083e00-ac56-43ae-a843-18ed6355fa73" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-quobyte-18083e00-ac56-43ae-a843-18ed6355fa73" acquired by "delete_volume" :: waited 0.014s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc6bde9-4bb4-4f86-862b-f48f71316349]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:33 devstack sudo[91827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73 Feb 26 20:37:33 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] Creating offline snapshot 228403cc-96ba-4844-9cbf-426f377eb650 of volume e0907f88-a77d-443e-8242-53546049ee82 {{(pid=83352) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecdb96d-c4d3-48b9-b9d2-1897f453a177]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:33 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73" returned: 0 in 0.549s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:33 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:33 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73 Feb 26 20:37:33 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:33 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 Feb 26 20:37:33 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:34 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-18083e00-ac56-43ae-a843-18ed6355fa73" returned: 0 in 0.428s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-quobyte-18083e00-ac56-43ae-a843-18ed6355fa73" released by "delete_volume" :: held 0.998s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Created reservations ['d7402243-2c9c-4d25-a0ee-212f32b6224f', 'bcfe965e-9ff2-442f-9462-4dfcd2ee5b01', '401633a3-b3be-44d0-b8fa-a48ba5096dc5', '26d34482-f005-46f2-af3f-2b90ab8facde'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:34 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82" returned: 0 in 0.545s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 1G {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:34 devstack sudo[91840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 1G Feb 26 20:37:34 devstack sudo[91840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:34 devstack sudo[91842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:34 devstack sudo[91842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:34 devstack sudo[91842]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.440s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:34 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Deleted volume successfully. Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-c1d1dad6-6763-4e57-bc38-a0719ae8a020 tempest-SnapshotDependencyTests-1556842265 None] Lock "cinder-18083e00-ac56-43ae-a843-18ed6355fa73-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:34 devstack sudo[91840]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 1G" returned: 0 in 0.522s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:34 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0907f88-a77d-443e-8242-53546049ee82 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:34 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0907f88-a77d-443e-8242-53546049ee82 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 Feb 26 20:37:34 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:35 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0907f88-a77d-443e-8242-53546049ee82 -F qcow2 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650" returned: 0 in 0.433s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:35 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 is being set with open permissions: ugo+rw Feb 26 20:37:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:35 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 Feb 26 20:37:35 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:35 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650" returned: 0 in 0.475s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:35 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:35 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.info Feb 26 20:37:35 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:36 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.info" returned: 0 in 0.512s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:36 devstack cinder-volume[83352]: WARNING cinder.volume.drivers.remotefs [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.info is being set with open permissions: ugo+rw Feb 26 20:37:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.info {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:36 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.info Feb 26 20:37:36 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:36 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.info" returned: 0 in 0.473s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:36 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.026s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:36 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0383cb60-604f-4980-b25a-0c8ab6714384 tempest-CinderUnicodeTest-181173779 None] Create snapshot completed successfully Feb 26 20:37:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Acquiring lock "cinder-228403cc-96ba-4844-9cbf-426f377eb650-delete_snapshot" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Lock "cinder-228403cc-96ba-4844-9cbf-426f377eb650-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Acquiring lock "cinder-quobyte-e0907f88-a77d-443e-8242-53546049ee82" by "delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Lock "cinder-quobyte-e0907f88-a77d-443e-8242-53546049ee82" acquired by "delete_snapshot" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Acquiring lock "cinder-quobyte-228403cc-96ba-4844-9cbf-426f377eb650" by "_delete_snapshot" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:37 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Lock "cinder-quobyte-228403cc-96ba-4844-9cbf-426f377eb650" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Deleting offline snapshot 228403cc-96ba-4844-9cbf-426f377eb650 of volume e0907f88-a77d-443e-8242-53546049ee82 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Feb 26 20:37:37 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] snapshot_file for this snap is: volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 {{(pid=83352) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Feb 26 20:37:37 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[c462098a-da6f-4707-929b-78455298b803]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:37 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:37 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 Feb 26 20:37:37 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:38 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650" returned: 0 in 0.492s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:38 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.remotefs [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0907f88-a77d-443e-8242-53546049ee82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83352) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Feb 26 20:37:38 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f14c858-7d38-4631-820a-8c3bebd36c8e]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:38 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 Feb 26 20:37:38 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:38 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82" returned: 0 in 0.498s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:38 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:38 devstack sudo[91874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 Feb 26 20:37:38 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:39 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650" returned: 0 in 0.464s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:39 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650 Feb 26 20:37:39 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:39 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82.228403cc-96ba-4844-9cbf-426f377eb650" returned: 0 in 0.422s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=175,cinder:UPDATE=257,cinder:INSERT=57,cinder:DELETE=22 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Lock "cinder-quobyte-228403cc-96ba-4844-9cbf-426f377eb650" released by "_delete_snapshot" :: held 1.932s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Lock "cinder-quobyte-e0907f88-a77d-443e-8242-53546049ee82" released by "delete_snapshot" :: held 1.953s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Created reservations ['03880678-4136-4c73-9521-7a4dc235d889', '4b4cef28-2471-45df-b476-67ee2487e7b9', 'cd594bb2-6773-43ab-a4a4-d780ea5701c6', '6c1ce98e-bb5b-43d5-b741-38a8249b1ee4'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:39 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Delete snapshot completed successfully. Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4e2793ad-72aa-480f-952a-0380c4c2aaee tempest-CinderUnicodeTest-181173779 None] Lock "cinder-228403cc-96ba-4844-9cbf-426f377eb650-delete_snapshot" released by "delete_snapshot" :: held 2.051s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Acquiring lock "cinder-e0907f88-a77d-443e-8242-53546049ee82-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Lock "cinder-e0907f88-a77d-443e-8242-53546049ee82-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Acquiring lock "cinder-quobyte-e0907f88-a77d-443e-8242-53546049ee82" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Lock "cinder-quobyte-e0907f88-a77d-443e-8242-53546049ee82" acquired by "delete_volume" :: waited 0.011s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1c82a6-2600-40d3-b03f-1798f602f5a2]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:39 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:40 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 Feb 26 20:37:40 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:40 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82" returned: 0 in 0.518s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:40 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82 Feb 26 20:37:40 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:40 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:40 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-e0907f88-a77d-443e-8242-53546049ee82" returned: 0 in 0.481s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:40 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Lock "cinder-quobyte-e0907f88-a77d-443e-8242-53546049ee82" released by "delete_volume" :: held 1.040s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:41 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Created reservations ['08ca1df2-f7fa-4cb3-968e-0677eef55357', '53ae02a8-4ae8-41dd-a7b8-4f5a219c57af', 'b60688b9-291e-4a30-8dc2-922b4de59533', 'c6120a38-8ea9-4835-9d7c-3f67364ef388'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:41 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:41 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:41 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:41 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:41 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.449s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:41 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:41 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Deleted volume successfully. Feb 26 20:37:41 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-4438cd4c-f691-4ff5-a15d-7cf56b99c8a4 tempest-CinderUnicodeTest-181173779 None] Lock "cinder-e0907f88-a77d-443e-8242-53546049ee82-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Acquiring lock "cinder-8fac0d90-b45b-404e-b59c-988a9d98e428-delete_volume" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Lock "cinder-8fac0d90-b45b-404e-b59c-988a9d98e428-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Acquiring lock "cinder-quobyte-8fac0d90-b45b-404e-b59c-988a9d98e428" by "delete_volume" {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Feb 26 20:37:42 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Lock "cinder-quobyte-8fac0d90-b45b-404e-b59c-988a9d98e428" acquired by "delete_volume" :: waited 0.008s {{(pid=83352) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Feb 26 20:37:42 devstack cinder-volume[83352]: DEBUG oslo.privsep.daemon [-] privsep: reply[82faef2a-ef3b-4083-bfab-eedd21d5c657]: (4, 'qcow2') {{(pid=84381) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Feb 26 20:37:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8fac0d90-b45b-404e-b59c-988a9d98e428 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:42 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8fac0d90-b45b-404e-b59c-988a9d98e428 Feb 26 20:37:42 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:42 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8fac0d90-b45b-404e-b59c-988a9d98e428" returned: 0 in 0.480s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:42 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8fac0d90-b45b-404e-b59c-988a9d98e428 {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:42 devstack sudo[91908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8fac0d90-b45b-404e-b59c-988a9d98e428 Feb 26 20:37:42 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:43 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c/volume-8fac0d90-b45b-404e-b59c-988a9d98e428" returned: 0 in 0.392s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Lock "cinder-quobyte-8fac0d90-b45b-404e-b59c-988a9d98e428" released by "delete_volume" :: held 0.892s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:43 devstack cinder-volume[83352]: DEBUG cinder.quota [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Created reservations ['1517ddb3-114e-46a2-932a-e343c8ce2013', '864cdcbd-8495-4f85-8e08-3ce31101d117', '09f6fbd0-faa3-4e4e-a0d8-05d6783f25f5', '160a5c65-4c58-4ca6-b166-19cdd96b6ae3'] {{(pid=83352) reserve /opt/stack/cinder/cinder/quota.py:752}} Feb 26 20:37:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Feb 26 20:37:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Feb 26 20:37:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316': None} {{(pid=83352) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Feb 26 20:37:43 devstack cinder-volume[83352]: DEBUG cinder.volume.drivers.quobyte [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-08888284-91cc-409d-91ef-224450256316'] {{(pid=83352) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Feb 26 20:37:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.lockutils [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=83352) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Feb 26 20:37:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Feb 26 20:37:43 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c Feb 26 20:37:43 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Feb 26 20:37:43 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Feb 26 20:37:43 devstack cinder-volume[83352]: DEBUG oslo_concurrency.processutils [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/12c31aca508ca95c0d4a90748f0bf73c" returned: 0 in 0.525s {{(pid=83352) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Feb 26 20:37:43 devstack cinder-volume[83352]: DEBUG cinder.manager [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Notifying Schedulers of capabilities ... {{(pid=83352) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Feb 26 20:37:43 devstack cinder-volume[83352]: INFO cinder.volume.manager [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Deleted volume successfully. Feb 26 20:37:43 devstack cinder-volume[83352]: DEBUG cinder.coordination [None req-0f8cd7eb-32d0-434f-b850-145123ca1737 tempest-CinderUnicodeTest-181173779 None] Lock "cinder-8fac0d90-b45b-404e-b59c-988a9d98e428-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=83352) __release /opt/stack/cinder/cinder/coordination.py:152}} Feb 26 20:37:53 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=25,cinder:DELETE=1 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Feb 26 20:37:53 devstack cinder-volume[83352]: DEBUG dbcounter [-] [83352] Writing DB stats cinder:SELECT=179,cinder:UPDATE=244,cinder:DELETE=23,cinder:INSERT=63 {{(pid=83352) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}